Rainbow Piano
Mixed Reality, interactive installation
Unity3D, Oculus Rift, MR platform
May 2017
About
This is the project I did with in 24hous when I was introduced to the MR platform. The basic idea is drawing with piano keyboard.This work use MR platform to track the position of MIDI keyboard and pass the position data on to Unity3D software. Unity3D transfer the MIDI signal to sound and render the drawing and its color according to keyboard's position and key.
Idea
When I was a child my piano teacher used color stickers stuck on the piano keys to help me to remember the location of each note. So I imaged myself as a painter drawing with the keys when I played the piano with color stickers on it. Now I experienced the Tilt Brush and I think drawing in VR is revolutionary expressive and creative. And I can realize my childhood dream by using mixed reality.
MR tracked MIDI keyboard
Color projection
Unity3D editor
Drawings
Rainbow_piano from hengshi kang .