asad-ismail/grounding-dino-finetuning

Fine tuning grounding Dino

👋 My name is Asad I like to write code, train vision and multimodal ML models and deploy them in production

🚀 Feel free to contibute to one of my existing projects or reach out for colaboration on a project.

grounding-dino-finetuning's Issues

Fine-tune the code

hello,
Is the fine-tuning code (train.py) not complete enough for normal training?

Issue in using the generated Fine-tuned weight file

I followed the document to set the library code. I generated my custom dataset as provided in the sample CSV file.

I used the groundingdino_swint_ogc.pth pre-trained model for the finetuning purpose and its corresponding config file. I ran the train.py provided in this code for training and the new weights were saved in my machine.

However, the issue appeared when I tried to test the model using the test.py file provided in this code. I configured the model path to the generated fine-tuned model while trying to predict a test image.

The Error is as below:
File "Grounding-Dino-FineTuning\groundingdino\util\inference.py" in Line number 37:
model.load_state_dict(clean_state_dict(checkpoint["model"]), strict=False)
KeyError: 'model'

Let me know how this issue can be rectified. Could the train.py script be missing something?