#Biophysical #AffectiveComputing #RealTimePerformance #AugmentedHuman
Affective Dynamics and Movement : Exploring Biophysical Expression at AAU Copenhagen
Participating in the BEAM doctoral workshop was a delightful, unexpected detour in my PhD journey. With the pressure of preparing for my presentation at the ICA conference in Gold Coast, squeezing in another trip seemed unwise. But the workshop’s theme — Biophysical Expression, Affective & Movement (BEAM) — was impossible to resist.
This hands-on workshop introduced cutting-edge sensor technologies for collecting physiological data and gave participants the opportunity to integrate these sensors into real-time performance. The focus was on augmenting human capabilities through computation, including machine learning.
Isn't that exactly what I need for my prototype? With a stellar lineup of guest lecturers, including Mark-David Hosale, Alan Macy, and Marco Donnarumma, and the workshop hosted at the nostalgic AAU Copenhagen, I couldn’t resist registering on the spot. And I’m glad I did — it turned out to be a truly enriching experience, even more than I expected.
Fionn's workshop piece, RESONANCE (real-time version), builds on Mark-David Hosale's Max/MSP patch, incorporating visual modifications created by Fionn. The piece aims to utilize participants' real-time ECG (heart rate) data to influence the generated sounds.
A Note of Appreciation
Kudos to Elizabeth Jochum and Dan Overholt for organizing such a valuable workshop and bringing together so many fascinating people. Under Grisha Coleman’s daily guidance, I was finally able to feel the difference in my body, experiencing the nuance of each subtle movement in a way I hadn’t before.
I’m deeply grateful to Mark-David Hosale and Alan Macy, whose bio-MECI workshop showcased a kaleidoscope of sensors, revealing their diverse potential applications along with the theoretical frameworks behind them. It was my first time seeing these tools in real life, not just in articles! From Electrocardiography (ECG) to Electromyography (EMG) and Respiratory effort (RSP), I got to explore an entire spectrum of physiological data. Thank you both for generously sharing your wealth of experience and offering continuous support.
Fionn's workshop piece, RESONANCE (humming version), is created from the humming sounds of 15 participants, recorded via sensors into Max/MSP. The composition preserves the essence of each individual's humming, with minimal modulation applied to each sound file to reflect the owner's personality.
I also want to express my appreciation for Marco Donnarumma’s insights into Deaf identity. His emphasis on approaching art with humility and honesty toward our own bodies resonated deeply with me. Without that sincere connection, creating meaningful art would be impossible. Thank you for actively bridging the gap between the hearing world and the often-overlooked Deaf culture.
Finally, it was not just fun but truly inspiring to exchange ideas with fellow PhD students and artists, learning about their research and creative projects. It was a pleasure meeting Sandro, Silke, Perlin, Katrine, Atilla, Anders, Shu, Derek, Ozou, Abhishek, and Vincenzo. I’m especially glad we were able to complete the humming piece together (see above). I look forward to new collaborations in the near future :)
Workshop recap:
1. Alan presented how different muscles affect the generated sound by using the Electromyography (EMG) sensor.
2. Ozou + Abhishek + Vincenzo group outcome: It utilises a mobile phone as a music controller, while Abhishek's EMG data is fed into the device to alter the music. Specifically, when Abhishek makes a fist, the increased resistance introduces more noise into the music.
3. Sandro + Silke + Perlin group outcome: Ritualistic Digital Painting for Ogun. [Visual mapping: TouchDesigner]
4. Derek + Shu group outcome: Shu utilises an Electrooculography (EOG) sensor to detect electronic pulses between the left and right eyes, triggering the algorithm to read the sentences. [Programming: Pure Data]
BONUS ➊ Tivoli Gardens ╳ The Little Mermaid
BONUS ➋ Swing Ride
【Credit】
Music: 'Hotaruno Hikari - Opening Title-' from TV series <It's Only Little Light in My Life • Season2> (1st video). 'ストロベリーアイスクリーム or レモンシャーベット' from TV series <問題のあるレストラン> (BONUS video).
Photography & Film: Hua-Chun Fan
Comments