Comments (3)
You may get better depth reading thanks to the IR laser projector, but I think you will still have the potential drawbacks explained there: https://github.com/geaxgx/depthai_blazepose#inferred-3d-vs-measured-3d :
First, a inferred keypoint may stand "outside" of its counterpart in the image and therefore in the aligned depth frame. It happens probably more frequently with extremities, and it can be explained by the inaccuracy of the model which is never 100% perfect. Secondly, we can't get depth for hidden keypoints.
from depthai_blazepose.
If I understand your code correctly you are currently using the RGB stereo camera to:
- use blaze pose on a 2d image to get 3d points
- then use the stereo camera to get a reference point?
- if so can I replace the stereo camera with the IR projector to get a reference point?
An alternative solution, implemented here, is to combine the inferred 3D world landmarks with the measured 3D location of one reference point, the center between hips. Compared to extremities, this reference point can be more robustly measured.
from depthai_blazepose.
If I understand your code correctly you are currently using the RGB stereo camera to:
use blaze pose on a 2d image to get 3d points
then use the stereo camera to get a reference point?
Yes, that's correct.
if so can I replace the stereo camera with the IR projector to get a reference point?
No, you still need the stereo camera. The IR projector is just helping the stereo matching process. You can see the IR projector as an additional source of light.
from depthai_blazepose.
Related Issues (20)
- RGB Image out of focus in xyz mode on D-Lite HOT 1
- Pose estimation for multiple people HOT 3
- Retrain blazepose HOT 1
- Question about shift_x = 0 and shift_y = 0 in mediapipe_utils.py HOT 4
- Question for xyz mode HOT 1
- Question HOT 8
- 3d absolute position of any keypoint HOT 1
- Problem with Spatial Location HOT 4
- problem on landmarks shift HOT 3
- Depth value in script HOT 5
- does each landmark have a visibility or confidence value? HOT 3
- how to specify IP address of OAK-D Pro HOT 7
- using IR LED and mono cameras for skeleton detection HOT 15
- run as standalone network device on OAK-D Pro POE HOT 3
- [ImageManip(7)] [error] Invalid configuration or input image -skipping frame HOT 21
- Input for landmark regression too small HOT 2
- How to replace ColorCamera with XLinkIn node? HOT 1
- AttributeError: 'depthai.node.Script' object has no attribute 'setScriptData' HOT 1
- align the person HOT 9
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from depthai_blazepose.