View Code? Open in Web Editor
NEW
Hand wave detector which uses custom yolov5s as a backbone for hand detection and random forest for wave classifier.
Python 34.39%
Jupyter Notebook 65.61%
hand_wave_detection's Introduction
Dataset |
Number of images |
Number of classes |
Classes |
Epochs |
HaGRID micro 3 classes |
1.3k |
3 |
Fist, Palm, No Gesture |
338/1000 (early stopping after 100) |
![Screenshot from 2024-08-17 16-55-34](https://private-user-images.githubusercontent.com/81018289/358852585-6a5c421f-7b74-4c15-ba0a-22abe9a55933.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjU0NjM0MzksIm5iZiI6MTcyNTQ2MzEzOSwicGF0aCI6Ii84MTAxODI4OS8zNTg4NTI1ODUtNmE1YzQyMWYtN2I3NC00YzE1LWJhMGEtMjJhYmU5YTU1OTMzLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA5MDQlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwOTA0VDE1MTg1OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWRjYTU5ZTYwMmQyZTBjNWU2YTNkMTRlNzllM2UwOTJlOGQxNWFkYzYwZDc1ODFiMzk4MTgxZDg4YWM4OGNkMzYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.MxzntoLOZRc0SMLGcRejpUbpYyGwZMXZmUBpjRsKCJQ)
![Screenshot from 2024-08-17 17-00-03](https://private-user-images.githubusercontent.com/81018289/358852790-c9523991-2523-45b0-bfbc-540472afc2bd.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjU0NjM0MzksIm5iZiI6MTcyNTQ2MzEzOSwicGF0aCI6Ii84MTAxODI4OS8zNTg4NTI3OTAtYzk1MjM5OTEtMjUyMy00NWIwLWJmYmMtNTQwNDcyYWZjMmJkLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA5MDQlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwOTA0VDE1MTg1OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPThlYzM3OWY3MzdiNTNjODcyODdlNzIyYWE4NmY3YzA3NzNlNWUyMmRjYjgwM2Q0OGU5MzcwYWE2N2I0Y2VhYTUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.-V2cdHELqDSHWJaAbnsnWB9SR4E49RQgeK7yx2xZKFA)
- SORT (Simple Online and Realtime Tracking)
- Multiple objects tracker (waits for 20 frames before terminating track)
Class |
Training |
Test |
wave |
video 1 |
|
wave |
video 2 |
|
wave |
video 3 |
|
non-wave |
video 4 |
|
non-wave |
video 5 |
|
wave |
|
video 6 |
non-wave |
|
video 7 |
- Training set: 287 wave and 321 non-wave signals
- Test set: 144 wave and 335 non-wave signals
- Features of the signal (
x
- blue, y
- green)
- Signal is of the length of 40 frames (camera runs on about 30 fps)
![Screenshot from 2024-08-17 17-10-13](https://private-user-images.githubusercontent.com/81018289/358853316-02b36914-416f-4f3e-bcaf-bf2d99f5d5b4.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjU0NjM0MzksIm5iZiI6MTcyNTQ2MzEzOSwicGF0aCI6Ii84MTAxODI4OS8zNTg4NTMzMTYtMDJiMzY5MTQtNDE2Zi00ZjNlLWJjYWYtYmYyZDk5ZjVkNWI0LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA5MDQlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwOTA0VDE1MTg1OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWE2Y2RjMzhmNDE2ODg3Mzk4YmZiMjc0ZTZiZDkwZDhhMDNhZjczMzA1YjE5Y2E0NTdkYTI2MThjMmU3NTYxZjMmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.mK3VnAsY1QcMKbCk8bSYdjyxVMYxOknJg45Ih-0wnkY)
- Random forest classificator
- 13 trees
- Test accuracy: 0.93
![Screenshot from 2024-08-17 17-11-50](https://private-user-images.githubusercontent.com/81018289/358853376-d5de78e1-9f48-4100-8f6f-be5d882a81c1.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjU0NjM0MzksIm5iZiI6MTcyNTQ2MzEzOSwicGF0aCI6Ii84MTAxODI4OS8zNTg4NTMzNzYtZDVkZTc4ZTEtOWY0OC00MTAwLThmNmYtYmU1ZDg4MmE4MWMxLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA5MDQlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwOTA0VDE1MTg1OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTAzMmI4NjBlYWIwNGM0ZGNmZDcxZGZjN2RmNjNiNTJjM2E5ZjQ0Nzc1M2JlZTU3MDZhZDYyMTg4MzJjZDE2NGQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.N64wh5yhQep3-iVQdqVCv4a5M_aX6Aw58QCnwjlZQFA)
hand_wave_detection's People
Watchers