The Sound of Soul: Biofeedback Controlled Music Generation and Sound Design
The aim of this project is to develop a system that allows biofeedback to be used as a creative musical tool through music generation and sound design. This system uses brainwave data from an electroencephalogram, as well as electromyography muscle activity. This biofeedback is then interpreted by a machine learning neural network which can be trained to classify the user’s psychological or physiological state. This determination will then be used to control a generative Artificial Intelligent MIDI generator or other MIDI Continuous Controller signals. The raw biofeedback, averaged brainwave amplitudes, and Fast Fourier Transform of the EEG signal can also be used to control MIDI generation and Digital Audio Workstation parameters directly, and for synthesizer generation and timbral control.
Valencia (Spain) Campus
Biofeedback; Artificial Intelligence; Neuroscience; Improvisation; Electroencephalogram
Project Components: project video (.mp4), reflection paper (.pdf), max plugin project files (ZIP file).
McCormack, Calvin. “The Sound of Soul: Biofeedback Controlled Music Generation and Sound Design.” Master's thesis, Berklee College of Music, 2021. https://remix.berklee.edu/graduate-studies-production-technology/281.