Thursday, November 19, 2009

SixthSense Developer’s Talk at TEDIndia

Pranav Mistry gave a talk at TEDIndia about his recent works and projects. He has developed many gestural input devices at MIT Media Lab.

He continuously talked about bridging gap between real life and digital worlds. More specifically, it seems that he is interested in controlling and getting information using everyday objects.

Here are some excerpts form his talk.

Low-cost data glove

What ever he named it, I call it a low-cost data glove. It’s made of two deconstructed mice.

Poor mice dissected
image image
Two mice are collectively transformed into a single data glove
image image

Quickies: Digital Notes

The second project is about digital note taking called Quickies. He showed demonstrations how a user can share, store, and print analogue sticky notes. Fore more information, the project page or following paper will help:
P. Mistry, "QUICKIES: the future of sticky notes," in Proceedings of the 27th international conference extended abstracts on Human factors in computing systems Boston, MA, USA: ACM, 2009.

image image
image image

He also introduced a 3D input pen.

image image


SixthSense is a 3D gestural interface using a small project, webcam, and microphone.

image image

It turns everyday surfaces into multi-touch gestural input pads – the core function of SixthSense. It is achieved by combining image processing and gesture recognition with images gathered by the webcam. You can see four color markers on his fingers. Those explicit markers can help processing algorithms easily figures out a user’s gestures.

image image

Applause I at the talk – taking a picture
image image

Applause II at the talk – live papers
image image

Other live surfaces
image  image  image image  image

Applause III: Paper Computer

SixthtSense can track touch with a microphone and camera. The microphone detects the sound of touch, and then the camera tracks the touch point. So, a normal sheet of paper acts as a computer with SixthSense.

image image

Wii-like gaming

Web browsing

Pick & Drop
This demo shows exchanging information between two objects. Note that the concept of pick & drop was first presented by Sony.

image image image image image

No comments:


Force, Pressure, and Touch -
Force pressure touch technology: FSR sensor, electronics, firmware and software
Design Service Low Cost Pressure Mapping
Related Posts with Thumbnails