Comments (15)
Nevermind I see the workflow collecting captcha files and I also saw this project https://github.com/beiyuouo/hcaptcha-model-factory for automatic model creation, so why is this not a part of the workflow. Maybe we can use GPT for classifieng which classes are "yes" or "bad" @beiyuouo . What do you guys think?
from hcaptcha-challenger.
You can perform the zero-shot image binary classification task by modifying the modelhub instance variable. You don't need to train the model yourself. CLIP can already handle all image classification tasks.
from hcaptcha-challenger.
I've tried it but it doesn't work well. Can you show me an example using it with "Click on the animals that don't walk"
edit: maybe i'm using it incorrectly, hence why I asked for an example
from hcaptcha-challenger.
I found why. There's an error in your code components/common.py L55 Should be "ket in label" not "label in ket"
from hcaptcha-challenger.
@QIN2DIM I opened a pull request. Please merge
from hcaptcha-challenger.
For CLIP, I have not provided a better reference case.
For CLIP prompt,I offer two trigger options.clip_candidates
and datalake
, at the moment I prefer datalake.
I plan to use clip_candidates to handle nested types of image binary classification tasks, i.e., challenges where the prompt is invariant but the positive sample can be constantly updated.
from hcaptcha-challenger.
There are still some issues with clip_candidates
, and I will subsequently change its data structure, which currently struggles to cope with the complex demands of prompt orchestration. I'd like it to be able to divide and conquer, and to further reduce inference pressure.
from hcaptcha-challenger.
The default is to use the RESNET-50 model, which is behind the times in terms of inference performance.
I will write a script later to determine if current hardware resources can run a better performing CLIP model.
from hcaptcha-challenger.
hcaptcha-challenger/hcaptcha_challenger/onnx/modelhub.py
Lines 295 to 308 in d5fa70a
from hcaptcha-challenger.
I have managed to get clip_candidates
to work but I dislike how the first element of the array is the correct one. Nothing indicates that and I had to read the code to identify it.
I think we should work on a CI that converts collected information into CLIP candidates automatically so we don't have to keep track of them manualy.
from hcaptcha-challenger.
I think we should work on a CI that converts collected information into CLIP candidates automatically so we don't have to keep track of them manualy.
You're right. That's what I want to do.
I have managed to get clip_candidates to work but I dislike how the first element of the array is the correct one. Nothing indicates that and I had to read the code to identify it.
I have provided a datalake
orchestration method to orchestrate Positive and Negative for a specific challenge-prompt.
The current data structure for clip_candidates
is failing miserably, and I'm already planning to replace it.
from hcaptcha-challenger.
hcaptcha-challenger/src/objects.yaml
Line 6 in d5fa70a
hcaptcha-challenger/src/objects.yaml
Line 736 in d5fa70a
from hcaptcha-challenger.
@QIN2DIM PR has been approved but it still hasn't been updated on pypi
from hcaptcha-challenger.
Updated
Actually, I rewrote clip_candidates about two weeks ago and also solved the current issue. However, that feature needs more testing, and I have been too busy recently.
from hcaptcha-challenger.
It's failing atm in every challenge :(
from hcaptcha-challenger.
Related Issues (20)
- [Challenge] Please click each image containing a pirate ship HOT 1
- [Challenge] [retrain] please click on the most similar object to the following reference shape
- [Challenge] [retrain] Please click on the object that appears only once
- feat(components): zero-shot object detection
- feat(control): nested CLIP candidates
- Can you give me an example code on using hcaptcha-challenger with selenium
- [Challenge] Please find and click on the letter K/W in the image below.
- [Challenge] Pleasae click at the star
- [Challenge] Please click each image containing a bumblebee
- Browserless Challenges HOT 1
- Solved
- google colab error
- url 'https://api.hcaptcha.com/getcaptcha/' returning base64 instead json HOT 8
- bug: workflow post-action
- feat(new-order): Integrated with LVM (large visual models) HOT 1
- [Challenge]
- feat(cloudflare-edge-node): FastAPI Python Workers
- feat(schema): Estimate Bottle Orientation with Computer Vision
- Solving captcha on queries
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hcaptcha-challenger.