Exploring Audiovisual Interaction Through Rich Video
Author
Boisen, Kasper Alexander Dahlsgaard
Term
4. term
Education
Publication year
2014
Submitted on
2014-05-28
Abstract
This thesis explores how sound and image influence each other in realistic, complex video environments, and how congruency between auditory and visual elements shapes audience perception. Building on cross-modal perception research, including the motion-bounce illusion (sound altering perceived visual motion) and Chion’s notion of synchresis, the study translates classic lab findings into rich video: high-production scenes with distracting, real-world detail. The work comprises five experiments: perceiving distance through sound; manipulating perceived direction and trajectory; testing the motion-bounce illusion in rich media; expectation formation after a partially obscured audio-visual event; and an integrated case combining prior insights. Data were collected via online questionnaires with embedded videos and selected interviews, with each experiment reporting design, implementation, testing, and results. Specific outcomes are presented in later chapters and are not detailed in this excerpt. The study aims to bridge theory and practice in sound and visual effects by examining how audio design choices can shape visual interpretation in realistic settings.
Dette speciale undersøger, hvordan lyd og billede påvirker hinanden i realistiske og komplekse videomiljøer, og hvilken rolle kongruens mellem visuelle og auditive elementer spiller for publikums opfattelse. Med udgangspunkt i teorier om krydsmodal perception, herunder motion-bounce illusionen (at lyd kan ændre oplevet visuel bevægelse) og Chions begreb om synchresis, omsætter studiet klassiske laboratoriefund til såkaldt rig video: videoklip i høj produktionskvalitet med forstyrrende, virkelighedsnære elementer. Arbejdet omfatter fem eksperimenter: perception af afstand via lyd; manipulation af oplevet retning og bane; afprøvning af motion-bounce illusionen i rig medie; forventningsdannelse efter en delvist skjult audiovisuel begivenhed; samt en samlet case, der kombinerer indsigter fra de foregående. Data blev indsamlet gennem online spørgeskemaer med indlejrede videoer og enkelte interviews, og hvert eksperiment beskriver design, implementering, test og resultater. De specifikke fund fremgår af de senere kapitler og er ikke detaljeret i det foreliggende uddrag. Studiet sigter mod at bygge bro mellem teori og praksis i lyd- og visuelle effekter ved at afprøve, hvordan designvalg i lyd kan forme visuel fortolkning i realistiske scenarier.
[This apstract has been generated with the help of AI directly from the project full text]
Other projects by the authors
Boisen, Kasper Alexander Dahlsgaard: