My wife and I wanted to make a special and experimental holiday greetings for this year. I got a chance to test a Leap Motion Developer Kit so we decided to make an air piano application and play a christmas song.
It was not difficult to make an air piano application using Leap Motion sensor but we found that it's not easy to play seriously. Because it's hard for the users to imagine position of fingers even though they can see a visualized screen while playing and there is no physical response while playing therefore the position of fingers could be passed to outside of active boundary. We had to think about creative solution. After several usability tests, we could figured the most challenges by adding help system like connecting lines between fingers and piano keys, virtual space boundary and visual responses.
Leap Motion Sensor
Air Piano Setup
Air Piano Setup
Air Piano Application
Air Piano Application
Playing "Chopsticks" song
Creative Direction, Code & Piano : Dofl Y.H. Yun Illustration & Piano : Mimi M.J. Kwon
Special thanks to : Ddalgi, my lovely kitten, CinderDome and Leap Motion company