TSUMU
Tack Stack User-interface for Music Utilities
| Introduction |
TSUMU (Tack Stack User-interface for Music Utilities) is novel interface for media players using a camera and hand actions. The music players are often used with other applications at the same time. However, conventional interfaces for music players use a mouse and a keyboard. For example, how do you do if you want to stop the music on operating a word processor? TSUMU makes it possible to control the player with more simple action than conventional interfaces.
| Algorithm |
Image Acquisition and Display
Open Source Computer Vision Library is used for acquiring and displaying images. A camera is set on the ordinary arrangement.Hand Detection
An algorithm to detect a hand region from images is described below. At first, Hand color regions are extracted using the color of each pixel. Pixels which have a color of a palm on Hue-Saturation plane are extracted, and the continuous pixels are labeled. Then, the largest region in the image is detected as a hand region.Hand Motion Analysis
A ratio of the size of the actual hand region to the size of the pseudo convex hull of the hand region. These figure show the convex hull of "Fist" and "Hand".
 |
 |
| "Fist": the block is "grabbed" when the hand forms "Fist" | "Hand": the block is "ungrabbed" when the hand forms it |
When the hand forms "Fist", a ratio of the size of actual hand region to the size of the pseudo convex hull of the region is approximate 1.0. On the other hand, when it forms "Hand" then the ratio of the size of the actual region to the size of the pseudo convex hull is smaller. The hand motion is analyzed using the ratio.
Media Control
Music files are controlled using Media Control Interface (MCI).
| Screenshots |
 |
 |
| Screenshot of List Mode | Screenshot of Play Mode |
| Downloads |
Manual (2 pages, PDF Format)
Video (Approx. 7MB, Windows Media Video)
