xuhao1/foxtracker

Facial Head Pose Tracker for Gaming

Introduction

FOXTracker is a facial head tracker for gaming usage. Perform as TrackIR or Opentrack (pointtracker) as track camera controller for Flight Simulation Games like DCS.

Prerequst

A normal web camera.

opentrack is recommend to install now.

Windows 10 x64 is only offically support operating system.

Usage

This program is still under development, not stable yet. I will never collect any user data from your camera.

Download FOXTracker at Release

This program supports control games directly or uses Opentrack as backend. For now, the spline function is in development, so use Opentrack is a good idea. If you are using this program individually, please modify config or the config.yaml.

Just turn your opentrack input to UDP and open FlightAgentX.exe. Everything works fine.

Also, you may use dcs.ini here.

Video can be found on https://www.bilibili.com/video/BV1fv411k778

Chinese Commentary https://www.bilibili.com/video/BV1ey4y1C7Za

Future Plan (Maybe in a year)

1. Try to reinforce the robust of the tracker.
2. Will add spline function.

LICENSE

LGPL

Third-party Libraries

OpenCV

dlib

UGlobalHotkey

yaml-cpp

Eigen

ONNX-Runtime

FSA-Net LICENSE: Apache 2.0 https://github.com/shamangary/FSA-Net/blob/master/LICENSE

OpenSeeFace Thanks @emilianavt 's network!

aitracker

介绍

这是一个基于面部识别的头瞄，用于模拟类游戏。和TrackIR或者opentrack（如国内流行的pointtracker）功能类似，但是只需要摄像头。 请参阅中文文档

视频见b站 https://www.bilibili.com/video/BV1ey4y1C7Za

未来一年内的开发计划

1. 加强脸瞄的稳定性
2. 加入曲线编辑功能

协议

LGPL

foxtracker's Issues

Use MJPEG format for high speed camera support

Windows 10 下高帧率相机默认采集无压缩 YUY2 流导致帧数降低到个位数，希望作者能添加一个启用 MJPEG 流的选项

在 src/HeadPoseDetector.cpp 里

    cap.set(cv::CAP_PROP_FRAME_WIDTH, 640);  
    cap.set(cv::CAP_PROP_FRAME_HEIGHT, 480);  
    cap.set(cv::CAP_PROP_FPS, settings->fps);  

加上

cap.set(cv::CV_CAP_PROP_FOURCC, cv::CV_FOURCC('M', 'J', 'P', 'G') );

就可以了。默认开启应该也没什么副作用。
谢谢！

Foxtracker Freezes when I go into DCS

Foxtracker has worked fine for a whilr, this is a new behavior i didnt have previously
As soon as I tab out it works fine

Very interesting project

Just want to say it’s fascinating you use FSA-Net on such interesting project. :)))))

目前还不支持win11吗？

希望摇杆热键能解绑

现在Hotkeys只能绑定不能解绑，希望增加在绑定窗口按Esc键或其他按键解绑的功能

several cameras

Hi! how can switch between cameras? I have 3 and fox chose wrong one

C1000e无图像输出

大佬好，使用的c1000e摄像头，但是无图像输出，id调整过了也没反应。使用opentracker有图像~

Issue with config properties

There is an issue with the following config properties:

out_bound_roll: 
out_bound_pitch: 
out_bound_yaw: 

For example, to get a value of 45 in the application one must set the config file to a value of 13.5

If you then change another property in the application it will overwrite the 13.5 with 45 in the config. When you next start the application it default to the maximum of 178.5. Finally it will be stuck at 178.5 (it will read 178.5 in the config, and in the application - I guess this is just the maximum value).

As a workaround you can make all property changes in the application, then manually edit the config file afterwards. As long as you do not change the properties from inside the application then you will not have to keep changing the config.yaml

如何切换摄像头

请问我下载了程序但是我电脑有多个摄像头该如何切换

What can I do on the source code or reference to make this software support win7 64bit?

I tried running this software without camera plugging in ,UI and setting seemed fine.
but when i plugged camera in and ran the software, i found that camera's output looked like the old television and then crashed.
Do you have any ideas to help me solve this problem? THX XD

打开软件后，无法显示图像并且闪退

打开软件如图，会变成橙色。等几秒钟会显示超大图像，并且等待几秒之后软件闪退

Config not saved

Hi...Everytime I'm using FoxTracker I must reconfigure the setting becose they are not saved...But it works very fine even in low light conditions with a 10$ camera....I'm using it mainly in DCS w/o Opentrack ...So why it's not saving properly the configs I made ? Thank you...

Tracking cannot resume after Face move out of camera range and return.

Tracking cannot resume after face move out(out of camera range) and return.

卡顿问题

在玩DCS时，如果window focus在foxtracker上，DCS的画面没有卡顿问题。但是一旦回到游戏中，画面极其卡顿。

但是在我配置更低的老电脑上反而没有这个问题，运行流畅。

我同时用opentrack。如果不用opentrack，会好很多，但是还是有明显卡顿

Help using with Logitech Webcam C615

I've been using opentrack with Aruco PaperMaker for a while. Wanted to try this one because it looks amazing.
But when I open foxtracker (even with admin rights) it just doesn't pick up my camera, I get no video. I changed the name of the camera in the dcs.ini from PS3 Eye to HD Webcam C615 (which is just as it shows on opentrack when using aruco).

Could you help me config FOXTracker recognize the my Logitech HD C615 camera?

建议把第三方的依赖也打包到git上

INCLUDEPATH += ../third_party/opencv-4.4.0-build/include
INCLUDEPATH +=../third_party/eigen-3.3.7
INCLUDEPATH += ../third_party/dlib/include
INCLUDEPATH += ../third_party/YAML_CPP/include
INCLUDEPATH += ../third_party/onnxruntime-win-x86-1.5.1/include

建议将pro中这几个依赖也放到git中，这样大家贡献代码的时候更方便，不用到处找依赖了。

0.1.1版本无法使用Camera 1，显示error

Camera 1: PS3摄像头 + CL-Eye驱动
同时0.0.8版本可正常使用，0.1.1界面截图如下。

In release, there is only sorce code

如果靠得太近会出现程序崩溃/闪退

如果靠得太近会出现程序崩溃/闪退

打开Foxtracker, (我小龙虾所有经常用)脸往凑着看,凑到它识别不了人脸的时候程序就崩溃了. 想必被我这帅脸惊艳到了

希望可以添加个异常捕捉什么的