Tangible Pads is an interactive experience that combines sound, lighting, movement and haptics. Each Tangible Pad represents a different instrument and is only activated when the user interacts with it. The more people join the experience the more instruments get activated. The music builds up in response to movement. This way, participants are able to motivate each other to move. They are also able to collaborate through dance to make more complex sounds. Each Tangible Pad is equipped with an actuator that provides haptic feedback and lights that change to the beat of music. These parameters coupled with sound help provide an immersive experience. Through this experience users are able to align their movement with the music, build off each others' movements and contribute to the making of the music.
Exhibitions Keio Media Design Forum 2017 Dubai International Film Festival 2017 SXSW Education Playground 2018
“Walk-In Music” is a system for new walking experience synchronized music and, feeling pseudo-gravity. This system synchronizes each step with the music being listened to and creates a feeling of generating music through walking. It creates a Walk-In state where music and walking are consistent at all times. In this state, changing the speed of music, the pedestrian may feel pseudo-gravity based on pseudo-haptics. Our results indicate that by changing the speed of music during the Walk-In state, the walking speed became faster and slower. We call this a Walk-Shift. This demonstrated the possibility of controlling personal walking by music. Walk-In Music has created a pleasant experience by music, and proposed a new relationship between people and music that leads to behavior changes.
Contribution Sound Design / Interaction Design
Publication UIST 2017: The ACM Symposium on User Interface Software and Technology
Haptic Hills is a collaboration piece with a Japanese Designer, Daiya Aida. Aida-san believes that steep surfaces motivates children to move more and turns a dull flat platform into a fun playful ground. Similarly, The tangible pads aim to incentivize others to move more through the use of music and haptic feedback. In this work, both of these concepts have been combined to create a playful and interactive landscape for children. The green pieces that have been inserted into the platforms play a musical instrument the moment someone steps on them. All the 5 pieces have different instrument that play at the same rhythm, which makes it possible for the children to create a musical piece simply by occupying all 5 spaces. Moreover, the tiles are capable of detecting the user’s movements and react to it by changing the music being played. This pushes the children to move more and bond together with others.
Synchrovibes is an Interactive music experience that aims to create bonds between participants and develop an environment for collaboration through movement synchronization. The interaction uses 3 platforms, each equipped with a speaker/transducer to produce sound and haptic feedback and LEDs for lighting. We use a cross-modality approach to achieve more immersion and make it easier for users to recognize the rhythm of the music. Each platform is also assigned a different instrument which is only activated when the participant is on top. The system compares movements to the music rhythm, if it judges that they are in sync, then more layers of the music are activated and the song can progress. Synchrovibes is a collective experience that is enhanced through team effort and peer to peer synchronization, Users collaborate through movement to complete a song together. During this experience, strangers can develop connections with others and feel a sense of team accomplishment.