Ghost Cubes

Interactive Installation

Physical Computing Project | SVA IXD

TEAM

Jinpei Wei, Bowen Shen, You Zhang

DURATION

November - December 2019

ROLE

Ideation, Prototyping

ADVISORS

Eric Forman (SVA|IXD)

INSTRUCTION

Ghost Cubes is an interactive piece that explores the concept of applying physical objects to visualize music through color/shape movements and using the body as the controller without touching any buttons or knobs. The project adapts leap motion, p5.js, and Arduino.​​​​​​​

6d97dd23-3c50-4e7b-b879-ad9c015589ab_rw_1920

INSPIRATION

Launchpads and MPCs are common music controllers, which have color LED buttons placed in a cubic grid. What if we use such a cubic form to visualize the music instead of controlling? To work around this idea, we did some research and came across the idea of using Japanese origami ghost cube to be the core mechanical structure because of its flexibility and Leap Motion as the technology choice to support touchless interaction.​​​​​​​

853579d4-6545-41f3-a459-a6629332129c_rw_1920
6efd311a-5c09-4d95-8124-d152c03eeb8b_rw_3840

STEPS OF INTERACTION

INPUTS

Leap motion provides some gesture readings such as the hand height, hand rotation, finger distance. It also distinguishes the difference between the right hand and the left hand.

OUTPUTS

Leap motion provides some gesture readings such as the hand height, hand rotation, finger distance. It also distinguishes the difference between the right hand and the left hand.

1-1

Input: the hight of a hand

2-1

Input: the angle of a hand

3

Output: rotation of the cube

ITERATIONS

After making the smaller scale model of the cubes, we understood the mechanical structure better. Thus, we were able to sketch out the whole object to combine the cubes and electronics. To diffuse the LED light, we used tracing paper to create the cubes.

6dccfb01-6575-4634-996c-c79523a32c9c_rw_1200
bb241dc6-d99d-4aab-8232-b6eb6b4d6aaf_rw_1200
11f123bf-e92c-4ccc-8ee6-c2a3dd6aa72f_rw_1200
01bb7d5e-a23d-4b1d-9ddc-ff1a7e9c25ed_rw_1200
462c35ba-b648-4e30-8390-3778e6c6d6bb_rw_1200

COMPONENTS

ee53a560-1d31-4a3a-9bba-a0be67ecd4d4_rw_1200

After making the smaller scale model of the cubes, we understood the mechanical structure better. Thus, we were able to sketch out the whole object to combine the cubes and electronics. To diffuse the LED light, we used tracing paper to create the cubes.

aa99e3fa-e789-4588-bd28-0c4b94ba5248_rw_1920

SOUND MANIPULATION

Using the filter() function from p5.js, we mapped the hand rotation and height values as sound volume and frequency to create filters that change the music while playing. The output turned out pretty well without much tuning.​​​​​​​

PRESENTATION @NEW LAB