Project Basics:
Xbox's Kinect sensor is a sensor that can detect a person body joints and output its skeletal position co-ordinates. Along with this, a Kinect sensor also output the depth information, voice control and RGB images of the person standing in front of it. This sensor has enormous application in many areas.
I made a project where a person, standing in front of the kinect sensor can control the 3D models of museum artifacts (zoom, translate, rotate and navigate on screen) for better exploration using his/her right and left hand. It was done by mapping the hands' co-ordinates (acquired from the kinect sensor) on different scenes of a Unity3d project. Unity3D was used because of its popularity, simplicity and possibilities that one can achieve with it. Most of the libraries were also open source unlike other game engines like Unreal. Most of the 3D models were modeled using Blender software.
Along with this, I also developed a glove which can provide haptic feedback when selecting an option or rotating/translating/zooming a model using this application. This haptic feedback provides a more real world experience for exploration.
This project was exhibited during an exhibition in Expo Center, Karachi. The video is uploaded below.
I made a project where a person, standing in front of the kinect sensor can control the 3D models of museum artifacts (zoom, translate, rotate and navigate on screen) for better exploration using his/her right and left hand. It was done by mapping the hands' co-ordinates (acquired from the kinect sensor) on different scenes of a Unity3d project. Unity3D was used because of its popularity, simplicity and possibilities that one can achieve with it. Most of the libraries were also open source unlike other game engines like Unreal. Most of the 3D models were modeled using Blender software.
Along with this, I also developed a glove which can provide haptic feedback when selecting an option or rotating/translating/zooming a model using this application. This haptic feedback provides a more real world experience for exploration.
This project was exhibited during an exhibition in Expo Center, Karachi. The video is uploaded below.