This report documents the development of new Human Interface Devices (HID) and their use in a 3D environment to enhance the immersion factor of a modeling tool such as an architecture designer software. The study focuses on studying and comparing two common devices used in vision-based motion tracking: the wiimote developed by Nintendo and a webcam. New means of interaction between the user and software, going beyond the mouse and keyboard bounds, are explored and described to interact efficiently and intuitively with desktop objects. In this system, the user’s fingers and head are infrared lighted by adapted gloves and frames fit with infrared diodes. The wiimote, developed by Nintendo, provides a high accuracy camera sensor whereas the webcam has a good detection range. Both are adapted answers to the application requirements. A 3D DirectX architect software, Master Builder, has been implemented, allowing the user to create his own buildings using his fingers and to view the result in 3D by moving his head. The resulting projects and the users tests revealed that infrared vision-based tracking fits perfectly to the tracking requirements and that handling objects by using both hands is much more interactive for the user than using common human device interfaces such as the mouse.