TouchMusic @CalHacks

  • Team Members: Alexa F. Siu, Michael Lin, Kenneth Lin, Kevin Chen
  • Institutions: Georgia Institute of Technology, University of California Berkeley
  • Challenge Post
  • Github repository

The TouchMusic glove is a wearable gadget that enables a music lover to physically experience their favorite songs. The glove does this by decoding a song’s rhythm and melody to construct patterns to vibrate into the hand. These palpable patterns will match the audible music for a synergistic, pleasurable sensation.

The software component (written in Python) first decodes the song into different bands of frequencies. After analyzing the bands with Fast Fourier Transform (FFT), it creates a sequence of vibrations that matches the song’s rhythm and melody. The sequence of vibrations is then serialized and sent to the micro-controller for the glove. Sewn with conductive thread, the glove has vibration motors and LEDs that are driven by the micro-controller.

TouchMusic glove overview showing a schematic of a computer with a music synthesizer, connected to the TouchMusic glove.
TouchMusic glove topview on a user's hand shows a white glove with flat coin cell vibration motors sewed around the glove with gray conductive thread.
TouchMusic glove front view shows the glove standing on a table.
TouchMusic glove back view shows the glove standing on the table from the back which has LEDs of different colors sewed onto it.

I traveled a long way for this hackathon but the experience was very worth it! Approaching my undergraduate graduation, this hackathon made me realize there was a thing or two I had learned through my undergraduate courses. This project brought to light my experience/knowledge in different domains from CAD, electrical and mechanical design, to more theoretical concepts such as signal processing and programming.

Designed by Alexa F. Siu. Powered by
Bootstrap 4, Jekyll and Jekyll-Scholar.