top of page
Body Jam
A.I. EXPERIMENT, POSENET, TENSORFLOW.JS, INTERACTION DESIGN
2020
Body Jam is a gestural interface that allows you to use body movements to manipulate an audio experiments.
What Can You Do
You can move your arms up and down to change the volume, move your head to map the delay effect, or add drum beats by hitting the ‘virtual button’ shows on your screen. The instruction cards will pop up and tell you how to move.
Change the Volume
Apply Pass Filter Effect
Add Drum Beat
How It Works
The system uses PoseNet, a machine learning library that maps out your body movements through a webcam, which can be accessed by anyone using a web-browser.
This experiment invites users everywhere to explore the creative possibilities of their own bodies and make new connections with music manipulation.
Made in collaboration with: Anqi Yang, Jehan Khattak, Tayyaba Taimur, Taavi Kervinen, Magda Mihalache
My Role: Project Concept, UX/UI Design and Machine Learning Exploration
Built With: Posenet, TensorFlow.js, Javascript, p5.js, p5.sound library
Get the code in Github and try
bottom of page