GESTUREMATE: UNLEASHING HANDS-FREE COMPUTER CONTROL USING DEEP LEARNING
Introduction
A new paradigm in human-computer interaction, a virtual mouse made of hand gestures
provides a novel way
to engage with digital interfaces. To give consumers a more natural and engaging computing
experience.Building a desktop application to enable a virtual mouse only leads to much more comfort for
the users to enable and use the virtual mouse easily. This application is built using Electron, an
open-source framework developed by GitHub.
App Working
Hand Gesture
Voice assistant:
App Working
Download the zip file and extract.
Open the application named "Gesture Mate".
Activate the microphone and start using.
Hand Gesture
Activate the microphone and command "Launch mate".
Now you can perform multiple operations like scrolling up and down, moving
left and right, clicking and dragging, and even screenshot.(For detailed information on how to use
watch the above video)
Voice assistant
Activate the microphone and talk commands
Launch MateWhat is today's dateWhat is the time nowPlay 'song/video name' by 'artist name'Play: plays newsStop listening