MuTable: Musical Table

Turn any surface into a musical instrument.

Hardware

• Projector
• Depth Camera (Intel RealSense)
• 2 Arduino Nano 33 BLE

Instructions

Hardware Setup

• Connect Projector and Camera to the laptop/desktop and keep it fixed for the session.

Installation Instructions

• Replace the mac addresses of the motion sensing bands with your own bands Right Band and Left Band here.
• pip3 install -r requirements.txt
• Program the arduino/motion sensing bands using tapDetection/BLEArduino/BLEArduino.ino
• Run python3 src/main.py
• Wait for about 30 seconds for the system to auto-calibrate and motion sensing bands to get connected to the system.

Code Overview

• Instrument specific code is here: src/instruments
• Sound bank is stored here: src/instruments/drums/sound_data
• Camera specific configuration is here: src/camera.py Current configuration is based on Intel Realsense camera.

System Overview and Demo

User Studies

User Study 1

User Study 2

User Study 3