unw9527/ai-gym-robot

ECE445 Senior Design: An AI gym robot for exercise guidance

AI gym robot for exercise guidance

This is the code for the pose evaluation part of the project Robot for gym exercise guidance in ECE445 senior design.

Overview

People are increasingly turning to exercise to improve their health and well-being. However, many individuals are unaware of the correct techniques for performing exercises, which can lead to injuries and other health issues. Though it is possible to hire a personal trainer to provide guidance, the expense is often prohibitively high.

This project tends to develop a robot to provide exercise guidance in a gym setting, monitoring the repititions of movements and generate feedback for incorrect movements.

Features

• Support two exercise types (squat and push-up)
• Count the repetitions of the exercise at runtime
• Generate a detailed report after the user finishes exercising, including:
  • Screenshots of the incorrect movements with feedback
  • The elapsed time of exercising
  • The total number of repetitions

How to run

Install the required packages in requirements.txt via pip. Then run with python main.py -t <exercise-type>, where the exercise type is either "squat" or "push-up".

Alternatively, if you want to run the program on a local video file instead of using your camera, add another flag -vs with the path to your video file (i.e. python main.py -t <exercise-type> -vs <path-to-your-video-file>).

Examples

Movement counting

We can count various forms of push-ups:)

(The input video file is trimmed from YouTube.)

Feedback generation

The program will generate a report containing the feedback. An example shown as below:

ai-gym-robot's Issues

I tried to run the project using Anaconda powershell prompt, but it seems that the counter is not increasing.

TODO list

@unw9527

• Improve squat counting (urgent)
  • angles to measure (e.g. hip? ankle?)
  • coordinates of feet should not vary too much
• Generate feedback to the user (i.e. high level requirement 3) (urgent)
  • Logging
  • Saved screenshots with comments
• (Not necessary. Depend on the time) Compile the counting mechanism and the GUI to make a release version

@brandonliu2

• Migrate the code to the robot (urgent)
  • Figure out how to switch from @Dalei-Jiang 's tracking to the GUI (urgent)
  • Test functionality
    • Is the counting mechanism working? (e.g. camera view)
    • Is the GUI working? (window position, button sensitivity, delay, etc.)
• Display the feedback to the user. (urgent)
• Improve the GUI. E.g.
  • Efficiency (e.g. is there a faster way to implement? Can switch to C++ if necessary)
  • Color (theme, text color, etc.)
  • Text (style, position, size, etc.)