Rainbow Piano

Mixed Reality, interactive installation

Unity3D, Oculus Rift, MR platform

May 2017

About

This is the project I did with in 24hous when I was introduced to the MR platform. The basic idea is drawing with piano keyboard.This work use MR platform to track the position of MIDI keyboard and pass the position data on to Unity3D software. Unity3D transfer the MIDI signal to sound and render the drawing and its color according to keyboard's position and key.

Idea

When I was a child my piano teacher used color stickers stuck on the piano keys to help me to remember the location of each note. So I imaged myself as a painter drawing with the keys when I played the piano with color stickers on it. Now I experienced the Tilt Brush and I think drawing in VR is revolutionary expressive and creative. And I can realize my childhood dream by using mixed reality.

MR tracked MIDI keyboard

Color projection

Unity3D editor

Drawings

Rainbow_piano from hengshi kang .