Comments (8)
I hope to have some news in Q2-Q3 on the topic...
from cvat.
Hi,
It is a feature in our mind which we don't have resources to implement till EOY for sure. If you can help it will be awesome. Development environment is described here: #18.
Several notes:
- Need to implement a separate Django application for the feature
- It isn't good to use turkic from VATIC because it isn't supported anymore. I would suggest using an official API (boto3?) - http://boto3.readthedocs.io/en/latest/reference/services/mturk.html
- Need to think how split a task on many HITs (by frame/image?) because HITs should be trivial. Also need to automatically create "verification" tasks to check results. In many case it will be necessary to merge annotation from several HITs.
- GUI to publish, view progress, ... Need to have sketch of it.
- The application should have REST API.
In general it is a big feature which cannot be easily implemented.
from cvat.
General requirements:
- Easy interface to create/review/accept an annotation task for MTurk (separate Django app).
- Probably need to have a separate instance on AWS for such tasks.
- Automatic authorization from MTurk, special group to access only links from MTurk django app
- Email notifications about deadlines to verify annotation tasks, etc...
Requirements (image annotation):
- One image per a segment. Thus it is easy to post such job as HIT.
- Several jobs for the same segment.
- Automatically correlate annotations in different jobs for the same segment. Automatically find "trash" in annotations and discard such HIT.
- Minimum number of jobs for a segment is 3.
- Maximum number of jobs for a segment is 7. After that need to verify or discard HITs due to low quality.
- One user cannot do annotations for the same segment (several similar jobs). Need to improve auth/permissions to access only specific jobs.
from cvat.
Hi, Wanted to know if any progress has been made in this direction :)
from cvat.
@nik13 , we are not working in the direction at the moment.
from cvat.
Nice overview of using a crowd sourcing platform (Toloka): https://www.youtube.com/watch?v=yyybisXHFc0
from cvat.
Has there been any progress on the integration with crowdsourcing platforms?
from cvat.
Very interested in this too!
from cvat.
Related Issues (20)
- Some issues with UI HOT 4
- Server crashes if image chunk size is too big > 512 Mb HOT 4
- Custom img model and metadata (UI) with serveless HOT 2
- CORS issue when trying to connect to API through local host (React app)
- Cannot restore task backup
- Very high consumption of storage for cvat_cvat_cache_db HOT 9
- [GSoC'24] Quality Control: Consensus
- `QualityApi.create_report` throws `missing required positional arguments` HOT 1
- pipeline video link broken
- Analytics for Task not Working HOT 7
- Store image & annotation data on a mounted drive HOT 2
- Implementation of a serverless tracking function with support for tracking by masks and polygons. HOT 1
- Backup not working following the guides HOT 2
- No logs in Analytics when using keyboard shortcuts HOT 4
- Down CVAT don't down docker serveless (function image) HOT 1
- When we look at the CVAT task, we see that the order of the labels is different from the one we created. HOT 1
- Total duration of zoom, change attributes and resize events HOT 3
- Lost Annotations HOT 1
- How does CVAT display images on GUI? HOT 1
- Secret key generation fails when deploying via Helm on Kubernetes (AKS)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cvat.