AAU Student Projects - visit Aalborg University's student projects portal
A master's thesis from Aalborg University

Partially Automated System for Synthesizing Human Facial Expressions in Interactive Media

Authors

;

Term

4. term

Education

Publication year

2012

Submitted on

Pages

85

Abstract

Denne afhandling præsenterer et realtidssystem, der genererer og styrer ansigtsanimation i interaktive medier som videospil. Målet er at gøre ansigtsudtryk og deres timing under afspilning mere naturtro. Systemet tager udgangspunkt i, hvordan ansigtets muskler fungerer og påvirker hinanden, for at nærme sig simulationslignende kvalitet, samtidig med at det forbliver hurtigt nok til realtidsrendering. Det bygger på Facial Action Coding System (FACS) udviklet af Paul Ekman samt forskning i blik- og hovedbevægelser af Argyle & Cook og Hader m.fl. Udviklere kan styre det overordnede udtryk, mens systemet automatisk tilføjer subtile lag af detaljer og timing for at få ansigter til at virke mindre kunstige. Systemet er implementeret og evalueret. Fremtidigt arbejde omfatter en Acting Emulator, der kan håndtere forskellige følelser og muligvis bruge signaler fra tale-lydfiler til at udløse samtalehandlinger.

This thesis presents a real-time system for generating and directing facial animation in interactive media such as video games. The goal is to make expressions and their timing during play feel more natural. The system is informed by how facial muscles work and interact, aiming for simulation-like quality while remaining fast enough for real-time rendering. It builds on the Facial Action Coding System (FACS) developed by Paul Ekman and on research into gaze and head movements by Argyle & Cook and by Hader et al. Developers set the overall intent of an expression, while the system automatically adds subtle layers of detail and timing to reduce an artificial look. The system has been implemented and evaluated. Future work includes an Acting Emulator that can handle different emotions and may use cues from speech audio to trigger conversational actions.

[This abstract was generated with the help of AI]