Comments (1)
This is probably caused by the non-pedestrian objects that are present in the MOT17 ground-truth, which have confidence set to 0. The apps.eval_motchallenge
script filters the ground-truth by min_confidence
while the same filtering is not applied to the predicted tracks. See the difference here:
py-motmetrics/motmetrics/apps/eval_motchallenge.py
Lines 101 to 102 in 008f45c
As a result, the non-pedestrian objects will be present in the predictions but not the ground-truth (100% recall but < 100% precision, as you are seeing).
This implementation matches the MOT challenge documentation: https://motchallenge.net/instructions/
The conf value contains the detection confidence in the det.txt files. For the ground truth, it acts as a flag whether the entry is to be considered. A value of 0 means that this particular instance is ignored in the evaluation, while any other value can be used to mark it as active. For submitted results, all lines in the .txt file are considered.
from py-motmetrics.
Related Issues (20)
- Do we need to keep original detection order? HOT 5
- About OSPA/GOSPA HOT 2
- Everything gets 0 / NaN if confidence is -1 in motChallenge format HOT 1
- AttributeError for `np.bool` in Numpy `1.24.0` HOT 5
- How to calculate IDF1 metric for multi-camera multi-target(MCMT,MTMC) tracking? HOT 1
- MOTP Metric
- Precision-Recall Curve
- Why idp and idr samein result?
- Custom dataset example in `README` gives worse results than `motmetrics.apps.eval_motchallenge`
- A BUG caused by pandas.Index.map
- can idp and idr be more than 1? HOT 1
- Person exits and re-enters
- Questions about values HOT 2
- mostly_tracked(MT) HOT 2
- Error with Default Option "ana" When Computing Metrics
- Do you plan to release a new version with HOTA on PyPI soon? HOT 2
- `UnboundLocalError` when calculating HOTA HOT 1
- Error when using README example for HOTA when using multiple files HOT 1
- Cannot match `trackeval` HOTA results using `motmetrics` on custom dataset HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from py-motmetrics.