A handheld musical instrument exploring the relationship between color and sound through the expression of our body motion and hand gesture. By using our physical environment as palettes, the music is composed with various considerations, beginning with basic questions of how we look, hear and experience our surroundings as well as investigating connections between eye, ear and hand or body, and how movement is involved to enhance multimodal sensory experience.

"Drawing in Space, Drawing with time, Drawing with Force, Drawing in Sound; Stepping into the 3D Drawing, Spatial Representation of Form/Force Evolution, Space as Sound" - MG

An interactive design tool where the user uses a wii-mote to draw and sketch in a particle-spring-like "live" environment.

WetPaint is an application that introduces a new way to view layers of a painting, where users can scrape and flip through the painting's layers. It is integrated with Flickr.com, where the multi-spectral scans of the painting are stored along with audio recordings about the images in notes. As the user scrapes through notes embedded in the paining, audio recordings play, which point out especially noteworthy parts of the image. Users can also leave their own audionotes on layers of the image.

Summer 2008, I was a software intern at Demiurge Studios and worked on a game that allows players to control the main character with their minds, using a headset developed by Emotiv. In a demo level, players go through a level where they're trained to scare away spirits by clenching their teeth, lift rocks and bend trees with only their thoughts. At the same time, the color and music of the demo level reacts to their engagement level.

Image from New York Times

Gallery space as a time machine: Visitors are invited to take one or more snapshots of themselves using a time-lapse shutter control. Their images are then overlapped over time, sometimes with the ghosts of strangers who co-occupied the same space in a different time. Using a proximity sensor, visitors are then encouraged to rewind time and see themselves occupying the same space with the ghosts of the people who existed there days ago.

Office 2007 set out a goal to provide a better graphics experience including charts, presentations, and diagrams. As the only designer for SmartArt, a new diagramming product-turned-integrated-feature and Visio 2007, I played a pivotal role delivering UI designs, consultation, and large quantities of content design. My process was presented as a best practices case at MS UX Day 2005. I must have been the youngest and most junior presenter that day, but I enjoyed the moment in the auditorium.

Consumer electronics devices are becoming more complicated, intimidating users. These devices do not know anything about everyday life or human goals, and they show irrelevant menus and options. Using common-sense reasoning, we are building a system, Roadie, with knowledge about the user's intentions; this knowledge will help the device to display relevant information to reach the user's goal. We are now constructing a Roadie interface to real consumer electronics devices, which communicate over Wi-Fi, and use the UPnP protocols.

During cooking process, family cooks are commonly unaware of how many calories go into their prepared meals. This work presents a smart kitchen with Ubicomp technology to improve home cooking by providing the number of calories of ingredients that are used in prepared meals. In doing so, family cooks can more effectively control the meal calories based on family needs. Our kitchen has sensors to track the number of calories in food ingredients, and then provides real-time feedback to users on these values.