Vision-Based Human Interaction Devices in a 3D Environment: Using Nintendo Wiimote, Webcam and DirectX
Authors
Luel, Thomas ; Mazzone, Florent
Term
4. term
Publication year
2009
Pages
102
Abstract
Denne afhandling udvikler og vurderer nye Human Interface Devices (HID) til et 3D-arkitekturværktøj for at øge indlevelse og brugervenlighed. Den sammenligner to kamerabaserede bevægelsessporingsløsninger: Nintendo Wii-fjernbetjeningen (Wiimote) og et almindeligt webkamera. I systemet bærer brugeren handsker og en let hovedbøjle med infrarøde (IR) lysdioder, så kameraerne kan spore fingerspidser og hovedbevægelser. Wiimotens indbyggede kamera giver høj positionsnøjagtighed, mens webkameraet tilbyder større detektionsområde; begge opfylder applikationens behov. Et DirectX-baseret 3D-prototypeprogram, Master Builder, blev udviklet, hvor brugeren kan “tegne” bygninger med fingrene og udforske resultatet ved at bevæge hovedet. Projektets resultater og brugertests viser, at IR-baseret sporing opfylder sporingskravene, og at to-hånds interaktion er mere engagerende end traditionel musestyring.
This thesis develops and evaluates new Human Interface Devices (HIDs) for a 3D architectural modeling tool to increase immersion and ease of use. It compares two camera-based motion-tracking options: the Nintendo Wii Remote (Wiimote) and a standard webcam. In the system, the user wears gloves and a lightweight head frame fitted with infrared (IR) LEDs, allowing the cameras to track fingertip and head movements. The Wiimote’s built-in camera provides high positional accuracy, while the webcam offers a larger detection range; both meet the application’s needs. A DirectX 3D prototype, Master Builder, was implemented, enabling users to “draw” buildings with their fingers and explore the result by moving their head. Project results and user tests show that IR vision-based tracking meets the tracking requirements, and that two-handed interaction is more engaging than traditional mouse control.
[This summary has been rewritten with the help of AI based on the project's original abstract]
Keywords