|
Interactive Machinery Display System
Mar. 2014 - May. 2014
This is a Kinect based three-dimensional interactive machinery display system. I designed and developed this system for Shandong Hongkang Machinery Manufacturing Co., Ltd.
Users can control the demonstrating process as well as 3D product models by hand gesture, which brings new visual experience to the exhibition than traditional two-dimensional ways. Users can simply control the display process by using the moving and hovering gesture, control the scaling of mechanical models by changing the pitch of palms, and control the rotation of models by raising hands.
Users can control the demonstrating process as well as 3D product models by hand gesture, which brings new visual experience to the exhibition than traditional two-dimensional ways. Users can simply control the display process by using the moving and hovering gesture, control the scaling of mechanical models by changing the pitch of palms, and control the rotation of models by raising hands.
|
HARDWARE:
Microsoft Kinect Projector SOFTWARE: Unity 3D 3D Max |
LANGUAGE:
C# TECHNOLOGY: Kinect Skeletal Tracking Technology Gesture Control |
|
Background& Movitation |
|
Development of human-computer interaction technology in recent years |
|
Birth of Microsoft Kinect technology |
|
Product exhibition’s constantly enhanced demand |
|
Tendency of changing two-dimensional to three-dimensional |
|
Design |
DESCRIPTION
This system is a Kinect based three-dimensional interactive machinery display system. Instead of traditional two-dimensional ways of presentation, like image and videos, three-dimensional ways are more intuitive and visual, and give more possibility of interaction. And also with using the hottest Kinect gesture controlled technology nowadays, makes the presentation more attractive and fashionable to audience.
There are five groups of hand gestures in this system, move and hover, horizontal spread and horizontal pinch, spread and pinch to explode, left hand up and right hand up and left hand down, which separately means move the cursor and select the button, scale up and scale down the model, explode the model, rotate the model and return to the previous menu. The demo pictures are shown below, the right pictures are the hand gesture, and the left pictures are the result display of the system.
There are five groups of hand gestures in this system, move and hover, horizontal spread and horizontal pinch, spread and pinch to explode, left hand up and right hand up and left hand down, which separately means move the cursor and select the button, scale up and scale down the model, explode the model, rotate the model and return to the previous menu. The demo pictures are shown below, the right pictures are the hand gesture, and the left pictures are the result display of the system.
CHALLENGES
The biggest challenge of the project is that there are many disturbed gestures. When the speakers give their presentation, they will also use many gesture to help express their meaning, and these gesture are all disturbed gestures for our system. We need to design the proper hand gestures to our system, not only letting the speakers feel natural, but also avoiding the disturbed gestures.
DEMO PICTURES
GROUP 1 | MOVE AND HOVER
Moving the right hand in front of the body to move the cursor, and hover over the button for 2 second to select.
The picture below is the main menu of the system.
Moving the right hand in front of the body to move the cursor, and hover over the button for 2 second to select.
The picture below is the main menu of the system.
|
|
|
MAIN MENU
|
MOVE AND HOVER
|
GROUP 2 | HORIZONTAL SPREAD AND PINCH
Changing the pitch of their palms to control the scaling of mechanical models. Horizontal spreading is to scale up the model as well as horizontal pinch is to scale down the model.
The picture below is display of the whole model.
|
|
|
MODEL OVERVIEW
|
HORIZONTAL SPREAD
|
The picture below is the scaled down model.
|
|
|
SCALE DOWN
|
HORIZONTAL PINCH
|
GROUP 3 | EXPLODE THE MODEL
In the explosion display menu, the horizontal spread and pinch gesture are used to explode and close the model.
The picture below is the overview of the explosion diaplay.
|
|
|
EXPLODE
|
EXPLODE THE MODEL
|
GROUP 4 | LEFT HAND UP AND RIGHT HAND UP
Raising left hand to rotate the model in the clockwise direction, and raise right hand to rotate the model in the counter-clockwise direction.
The picture below is counter-clockwise rotated model.
|
|
|
COUNTER-CLOCKWISE ROTATE
|
RIGHT HAND UP
|
GROUP 5| LEFT HAND DOWN
Leaving the left hand about 3 inches from the body to return to the previous menu.
The picture below is showing the returned main menu.
GROUP 5| LEFT HAND DOWN
Leaving the left hand about 3 inches from the body to return to the previous menu.
The picture below is showing the returned main menu.
|
|
|
RETURN TO THE MAIN MENU
|
LEFT HAND DOWN
|
OTHER SYSTEM DEMO PICTURES
|
|
|
|