Replacing a Mouse with Hand Gesture in a Plane-Based Augmented Reality System

  1. (PDF, 546 KB)
AuthorSearch for: ; Search for:
ConferenceThe 16th International Conference on Vision Interface, June 11-13, 2003., Halifax, Nova Scotia, Canada
Subjectgesture recognition; augmented reality; virtual interface; image stabilization; occlusion detection; computer vision; réalité augmentée; interface virtuelle; stabilisation d'image; détection d'occlusion; vision par ordinateur
AbstractA modern tool being explored by researchers is the technological augmentation of human perception known as Augmented Reality (AR). In this paradigm the user sees the real world along with virtual objects and annotations of that world. This synthesis requires the proper registration of virtual information with the real scene, implying the computer's knowledge of the user's viewpoint. Current computer vision techniques, using planar targets within a captured video representation of the user's perspective, can be used to extract the mathematical definition of that perspective in real-time. These embedded targets can be subject to physical occlusion, which can corrupt the integrity of the calculations. This paper presents an occlusion silhouette extraction scheme that uses image stabilization to simplify the detection of target occlusion. Using this extraction scheme, the paper also presents a novel approach to hand gesture-based interaction with the virtual augmentation. An implemented interaction system is described, which applies this technology to the manipulation of a virtual control panel using simple hand gestures to simulate mouse control.
Publication date
AffiliationNRC Institute for Information Technology; National Research Council Canada
Peer reviewedNo
NRC number46491
NPARC number8913375
Export citationExport as RIS
Report a correctionReport a correction
Record identifier2318fd2b-a06f-4b45-b9ec-83a4800af82d
Record created2009-04-22
Record modified2016-05-09
Bookmark and share
  • Share this page with Facebook (Opens in a new window)
  • Share this page with Twitter (Opens in a new window)
  • Share this page with Google+ (Opens in a new window)
  • Share this page with Delicious (Opens in a new window)
Date modified: