sherkspear/airgesture

Play games without touching keyboard

[PYTHON] AirGesture - Play games without touching keyboard

Introduction

Here is my python source code for AirGesture - Play games without touching keyboard. This project is an application of hand detection model in Tensorflow. With my code, you could play many games on PC without using any keyboard. At the moment you could play the following games

• Super Mario Bros by running the script mario.py
• Battle City by running the script battle_city.py
• Dinosaur Game by running the script dinosaur.py

Please make sure that only one hand shown in front of camera. Otherwise scripts may not work as well as you expect

Super Mario Bros

The screen is splitted into 3 equal parts horizontally. Here is the mapping between your gesture and Mario's movement:

• Open hand within the left part -> Left jump
• Closed hand within the left part -> Left run
• Open hand within the middle part -> Jump
• Closed hand within the middle part -> Do nothing
• Open hand within the right part -> Right jump
• Closed hand within the right part -> Right run

Super Mario Bros

Battle City

The screen is splitted into 5 parts, including 4 triangles and a circle. Here is the mapping between your gesture and tank's movement:

• Open hand -> Fire
• Closed hand within the circle -> Do nothing
• Closed hand within the left triangle -> Go left
• Closed hand within the right triangle -> Go right
• Closed hand within the up triangle -> Go up
• Closed hand within the left triangle -> Go down

Battle City

Dinosaur Game

The screen is splitted into 2 equal parts vertically. Here is the mapping between your gesture and dinosaur's action:

• Closed hand -> Run
• Open hand within the upper part -> Jump
• Open hand within the lower part -> Duck

Dinosaur

Requirements

• python 3.x
• cv2
• tensorflow
• numpy
• gym
• gym_super_mario_bros
• gym_chrome_dino
• pygame
• opencv