Pulse Flow: Exploring Affective Connection Through Sound and Visuals

Abstract

This thesis focuses on the affective aspects of human connection, exploring how an interactive installation can create the feeling of connection between two participants. By removing verbal cues and relying on visual and auditory elements such as heartbeats, the installation tries to create a space where participants can experience a shared connection through their bodies and senses. The theoretical framework examines the nature of connection and related theories, while incorporating relevant design strategies in relation to technology, such as Interpersonal Distance, Affective-Self Disclosure, and Shared Experiences and Play. These and other strategies were integrated into the design features aiming to encourage self-awareness, awareness of the other participant, and potentially foster a feeling of connection between them. The project’s implementation was achieved by integrating Kinect v2 for position tracking, real-time heartbeat detection (using the ESP32 M5Stack Atom Matrix and a pulse sensor), projections, and TouchDesigner as the primary tool for audiovisual integration. The evaluation combined both quantitative (System Usability Scale (SUS) questionnaire, movement proximity tracking and heart rate data) and qualitative (semi-structured interviews) methods. A total of 16 participants were tested, consisting of 4 familiar and 4 unfamiliar couples. The results revealed that the installation mediated a sense of connection, particularly through shared situational connection, non-verbal interaction and others. Familiar couples engaged more playfully and interactively, while unfamiliar couples described the experience as calming and meditative, appreciating the non-verbal communication. Some technical challenges, such as position tracking issues and sensor calibration errors, occurred. Future improvements will focus on enhancing interactivity and addressing the identified technical limitations.

Colophon: This page is part of the AAU Student Projects portal, which is run by Aalborg University. Here, you can find and download publicly available bachelor's theses and master's projects from across the university dating from 2008 onwards. Student projects from before 2008 are available in printed form at Aalborg University Library.

If you have any questions about AAU Student Projects or the research registration, dissemination and analysis at Aalborg University, please feel free to contact the VBN team. You can also find more information in the AAU Student Projects FAQs.

A master thesis from Aalborg University

Pulse Flow: Exploring Affective Connection Through Sound and Visuals