Human computer interface based on hand gesture recognition

Show full item record

Please use this identifier to cite or link to this item:

Title: Human computer interface based on hand gesture recognition
Author: Bernard, Arnaud Jean Marc
Abstract: With the improvement of multimedia technologies such as broadband-enabled HDTV, video on demand and internet TV, the computer and the TV are merging to become a single device. Moreover the previously cited technologies as well as DVD or Blu-ray can provide menu navigation and interactive content. The growing interest in video conferencing led to the integration of the webcam in different devices such as laptop, cell phones and even the TV set. Our approach is to directly use an embedded webcam to remotely control a TV set using hand gestures. Using specific gestures, a user is able to control the TV. A dedicated interface can then be used to select a TV channel, adjust volume or browse videos from an online streaming server. This approach leads to several challenges. The first is the use of a simple webcam which leads to a vision based system. From the single webcam, we need to recognize the hand and identify its gesture or trajectory. A TV set is usually installed in a living room which implies constraints such as a potentially moving background and luminance change. These issues will be further discussed as well as the methods developed to resolve them. Video browsing is one example of the use of gesture recognition. To illustrate another application, we developed a simple game controlled by hand gestures. The emergence of 3D TVs is allowing the development of 3D video conferencing. Therefore we also consider the use of a stereo camera to recognize hand gesture.
Type: Thesis
Date: 2010-08-24
Publisher: Georgia Institute of Technology
Subject: Video game
Skin color segmentation
H.264 motion vectors
Human computer interface
Hand gesture recognition
Template matching
Haar cascade
Computer vision
Video processing
Television remote control
Human-computer interaction
User-centered system design
User interfaces (Computer systems)
Department: Electrical and Computer Engineering
Advisor: Committee Chair: Benny K. Bing
Degree: MS

All materials in SMARTech are protected under U.S. Copyright Law and all rights are reserved, unless otherwise specifically indicated on or in the materials.

Files in this item

Files Size Format View
bernard_arnaud_j_201012_mast.pdf 5.493Mb PDF View/ Open

This item appears in the following Collection(s)

Show full item record