Finger Recognition and Gesture based Augmented Virtual Devices

In this project, we have tried to reduce the gap between the real world and the augmented environment to produce a mixed reality system. For that purpose, we created a virtually controllable keyboard system which is created and implemented using OpenCV libraries and python3.2.1. To provide an easy immersive augmented experience which is also gesture enabled, we employ a web camera which is integrated with OpenCV libraries through a compiler. Using our system, users can control a virtual keyboard using their finger movements and finger tips. Further, users can communicate with people who are viewing the screen, the user selects an alphabet with their fingertip and can move the keyboard with the help of hand gesture. Our model can be utilized by people who are specially-abled and people who cannot talk properly or communicate as they can communicate with others using our proposed system. This paper describes the way of implementing a virtual keyboard without any additional hardware but by using the webcam available in the system. The webcam simply captures the consecutive frames and compares them to recognize it as a click if there is a difference in the contour.