Glowphonic

Glowphonic is an interactive digital musical instrument with touch-sensitive petals for playing notes and a 6-DOF IMU that modulates tremolo. It features responsive lighting that blinks to touch or audio amplitude, with sensor data sent to Max/MSP and synchronized visuals controlled by an ESP32.

DEMO

HARDWARE OVERVIEW

Glowphonic integrates multiple sensors and microcontrollers:

  • 12-Key Capacitive Touch Sensor: Plays notes from two keyboards via Max/MSP.
  • 6-DOF IMU: Tilting forward (x-axis) increases the tremolo of an audio sample.
  • Slide Potentiometer: Controls keyboard volume.
  • Ultrasonic Distance Sensor: Controls sample loop speed—closer distances loop faster.

Sensor readings are collected by an Arduino Nano and sent to Max/MSP over serial USB. Max interprets this data and sends visual triggers—such as note activations or amplitude spikes—via a second serial connection to an ESP32-S3. The ESP32-S3 controls a NeoPixel LED strip, blinking in response to these events to create synchronized light feedback.

DESIGN

The electronics are mounted inside a cherry blossom-style lampshade. The touch wires extend to the petals using conductive tape, turning them into large capacitive surfaces. The distance sensor is mounted at the top to remain unobstructed.

Sensor interface diagram
Circuit Diagram for Sensor Readings
LED control circuit
Circuit Diagram to Blink LED Lights
Max Code
Max Code Annotations

BUILD

Interior
Interior
Full Build
Full Build
Interior
Glowing

INSPIRATION

Glowphonic was inspired by Jonathan Sparks’ NOMIS, winner of the 2015 Guthman People’s Choice Award, which produced melodies and layered glowing loops via gesture and light.

REFERENCES

HARDWARE COMPONENTS

Other materials:

  • USB-C to USB-C cables (x2)
  • 5V 5A AC to DC Power Supply for LEDs
  • Copper Conductive Tape
  • Jumper Wires (50cm)