Aligned is a yoga pose correction web app that processes video of a user’s yoga pose and provides feedback on how to improve the pose. The app was built using Flask and runs on an Amazon EC2 instance with GPU for deep learning.
Aligned was selected by USF faculty as one of the top apps of 2019 and, as a result, our team had the opportunity to present the app to a panel of VCs. We plan to continue developing Aligned as a side project in the near future. Please note that the app's website is not currently operational due to the high cost of continuously running the EC2.
- User logs in and selects which pose to evaluate
- App provides instructions on how to execute the pose
- Once ready, the user records a video of themselves doing the pose within the app (using webcam)
- Video is automatically processed using OpenPose, an open-source, deep learning-based library for keypoint detection.
- The app uses the keypoints from OpenPose to classify different pose faults using a rule-based system.
- Feedback is provided to the user on how they can safely improve their pose.
- Final Presentation Slides to VCs
- Flask routes
- Video processing script
- Modeling
- OpenPose research paper
Katja Wittfoth, Brian Dorsey, Quinn Keck, Evan Calkins, Sankeerti Haniyur, Connor Swanson, Maria Vasilenko