Below highlights selected research projects that I have been involved in.
We are exploring how fabric, a commonplace medium, can be used as a 3D input device to design surfaces, more specifically costume and garment design.
The below video highlights an early version of the system,and shows a sketch of how interacting with fabric could look like, and how we can use it for design.
Leal, A., Schaefer, L., Bowman, D., Quek, F., and Stiles, C. “3D Sketching Using Interactive Fabric for Tangible and Bimanual Input.” In the proceedings of Graphics Interface 2011. May 2011. (31% acceptance rate)
Leal, A., Bowman, D., and Quek, F. “Innovative 3D Surface Design Using Fabric: 3D Tangible, Two-Handed Direct Input.” CHI 2010, at CHIMe Workshop & Grace Hopper’s Celebration of Women in Computing 2010.
With our goal of developing novel and cool 3D interface, Andy Wood and I, advised by Doug Bowman, made a waterbending trainer app, where you control water using continuous, martial arts-like movements. Inspired by Avatar: The Last Airbender, we wanted players to fully control the water, not just -do a static pose- and some fixed burst of water shoots out. You can control anything from the intensity, speed, and angle of moving water, depending on how you do the martial arts-like gestures, using a 3DTV, a Microsoft Kinect, and Unreal Development Kit.
Symposium of 3DUI Grand Prize 2010
The Symposium of 3D User Interfaces held its first ever contest. The basis of the contest was to pick small objects in a large supermarket. We won 1st prize live contest!! Below is what we developed:
P. Figueroa, Y. Kitamura, S. Kuntz, L. Vanacken, S. Maesen, T. D. Weyer, S. Notelaers, J. R. Octavia, A. Beznosyk, K. Coninx, F. Bacim, R. Kopper, A. Leal, T. Ni, and D. A. Bowman. 3DUI 2010 contest grand prize winners. IEEE Computer Graphics and Applications, 30:86–96, 2010.
Chatty Wheatley: Multi-sensor plush toy
As a project to build innovative interactions with electronics in physical computing, Yasmine El-Glady and I built Wheatley, inspired by a ball-like robot character from the hit game Portal 2.
Using an arduino, audio shield, tilt sensor, ultrasonic sensor, accelerometer and more, Wheatley can chat with you as you walk by him, say goodbye, and react when he gets carried or set down. He also randomly talks to himself to keep himself company when he is alone.
This project wasn’t only an electronics-heavy project. It involved programming and processing and design work in making the plushie.
From the project description:
STAGES is tool that enables students to author and tangibly interact with non-linear stories. The purpose of STAGES is to encourage students to think divergently and engage in a deeper imagination concerning the stories they create.