om-ai-lab / omdet Goto Github PK
View Code? Open in Web Editor NEWReal-time and accurate open-vocabulary end-to-end object detection
License: Apache License 2.0
Real-time and accurate open-vocabulary end-to-end object detection
License: Apache License 2.0
A quick question. Has this work been accepted in any peer-reviewed conference? like ECCV24?
Thank you so much.
您好作者,我对您的研究非常感兴趣,但是我遇到了一些问题,需要您的解答:
1.请问一下在使用模型预测时能否不设定词汇表,像yolo-world那样直接预测图片。或者说我如何查看clip的词汇表里面是否有我需要检测的目标?
2.能否使用自己的预训练clip权重并使用自己的数据集训练OmDet模型吗?
非常感谢解答!
根据OmAgent设置好了OmDet但是在测试的时候发现目前这个版本的OmDet并不支持base64模式的数据传输?
Would it be crazy to try to run the turbo model on a CPU? Or is there a tiny version that could be run on CPU?
It is glad to see your work OmDet-Turbo that I have used GroundingDINO for so long. It seems on some datasets, OmDet-Turbo-Base is competitive. However, currently it seems only the Swin-Tiny-based version is released. How about OmDet-Turbo-Base ?
Hi, I am trying to convert the .py model to coreML form , but couldn't succeeded and then after converting the model successfully to ONNNX form , still can't convert the model in coreML to use in an IOS application. Kindly direct me to do the same.
Thanks and Regards
碰巧看到您有GroundingDino导出为TensorRT的分享
想问一下您那边有FP32 的tensorRT版本的GroundingDino分享一下吗?
Hello, author, your work is excellent. I have a question about tensorrt-groundingdino on your paper "Real-time Transformer-based Open-Vocabulary Detection with Efficient Fusion Head", I can only convert gd in tensorrt-fp32 by trtexec which is around 90ms on A100, could you share your menthod on how to convert gd to tensorrt? Thank you.
关于Oinw35@mAP=30.1有些疑问:
1、在OmDetv2中(2024的IET CV)这篇文章中,ConvNext-B的性能是20.9,此篇文章性能为30.1(模型较小但是SOTA),性能差异较大,是否出现了笔误?
Hi,
I am trying to try the inference demo following the install.dm. It seems the 'requirements.txt' file is missing. Could you please upload the 'requirements.txt' ? Thank you so much.
nice work! Is there a way to export onnx both text backbone and omdet, similar to yolo-world?
Hi Om people!
I am an MLE at Hugging Face, and given the popularity and performance of your model, we wanted to see if you would be interested in working with us to integrate OmDet Turbo into the Transformers 🤗 library. Looking forward to hearing back from you!
Best,
Yoni
How long does the pre-train take? I see you use 16 A100 and I want to know the approximate training time . Thanks.
And further more, I can't find the training code from scratch.
Hi! Yoni from Hugging Face again.
I'm opening a separate issue because there seems to be a potentially important problem in the model's encoder.
OmDet/omdet/omdet_v2_turbo/ela_encoder.py
Line 27 in 542ce97
Shouldn't this MultiHeadAttention be initialized with batch_first=True
, as the inputs of the self_attn layer are of the shape (batch_size, ...)? This causes inconsistencies when using the model for batch inference.
Thanks for your consideration!
awesome work!!
can you provide sample code to convert pytorch to onnx ?
hi, this is a good job.
do you have the plan to release the train code???
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.