Overview
Glowphonic is an interactive digital musical instrument with touch-sensitive petals for playing notes and a 6-DOF IMU that modulates tremolo. It features responsive lighting that blinks to touch or audio amplitude, with sensor data sent to Max/MSP and synchronized visuals controlled by an ESP32.
Hardware Overview
Glowphonic integrates multiple sensors and microcontrollers:
- 12-Key Capacitive Touch Sensor: Plays notes from two keyboards via Max/MSP.
- 6-DOF IMU: Tilting forward (x-axis) increases the tremolo of an audio sample.
- Slide Potentiometer: Controls keyboard volume.
- Ultrasonic Distance Sensor: Controls sample loop speed. Closer distances loop faster.
Sensor readings are collected by an Arduino Nano and sent to Max/MSP over serial USB. Max interprets this data and sends visual triggers, such as note activations or amplitude spikes, via a second serial connection to an ESP32-S3. The ESP32-S3 controls a NeoPixel LED strip, blinking in response to these events to create synchronized light feedback.
Design
The electronics are mounted inside a cherry blossom-style lampshade. The touch wires extend to the petals using conductive tape, turning them into large capacitive surfaces. The distance sensor is mounted at the top to remain unobstructed.
Build
Inspiration
Glowphonic was inspired by Jonathan Sparks’ NOMIS, winner of the 2015 Guthman People’s Choice Award, which produced melodies and layered glowing loops via gesture and light.
References
- Tremolo Effect in Max/MSP
- NeoPixel LED Guide
- Ultrasonic Sensor Tutorial
- MPR121 Capacitive Touch Sensor Guide
- Music Samples
Hardware Components
- Arduino Nano
- ProS3 - ESP32-S3 Development Board
- Ultrasonic Distance Sensor (x4)
- Adafruit 12-Key Capacitive Touch Sensor Breakout
- Adafruit ISM330DHCX 6-DOF IMU
- Slide Potentiometer
- Adafruit NeoPixel Digital RGB LED Strip
- Cherry Blossom Lampshade
Other materials:
- USB-C to USB-C cables (x2)
- 5V 5A AC to DC Power Supply for LEDs
- Copper Conductive Tape
- Jumper Wires (50cm)