Tach-Mouse

Hand Interface for Searching on Large Map Area

Overview

Many interfaces using hand are proposed,and hand is often used for pointing direction in real life.

In consideration of such role of hand,we considered that hand is also feasible for pointing mouse cursor.

We proposed a mouse cursor motion with hand gesture,and applicated for searching on map.

This system enables you to control the cursor and scaling of map with hand intuitivelly.

Recognition of gesture

Ther are three hand gestures shown in Fig1.The angle of waving is reflected to the direction of mouse cursor,

and the inclination is reflected to the speed of mouse cursor. Sliding is reflected to the scale of a map.

Fig1. Gestures

A image captured by USB camera is converted to HSV color space,and the skin color area is extracted and binalized.

Then PCA is applied to the area.The eigen vector of the first principal component represents the angle of waving.

The contribution of first principal component represents quantity of inclination.

The center of gravity of hand area represents sliding gesture.

Fig2.Flow of image processing

 

 

System overview

Screenshot

 

Screenshot

Contact

jumpei-m at is.naist.jp

PDF

Movie(Map manipulation)

Movie2(Folder manipulation)