Comments (8)
@sleepingcat4 Am also looking for the same have you got anything on this.
Please let me know if you got anything.
from big_vision.
@Naziyashaik09 I've actually solved this problem.
from big_vision.
@sleepingcat4 Please can you share me the code or the notebook link.
from big_vision.
The main colab has examples of how to tune the model and make predictions (aka inference): https://colab.research.google.com/github/google-research/big_vision/blob/main/big_vision/configs/proj/paligemma/finetune_paligemma.ipynb.
Is there something specific that is unclear?
from big_vision.
@Naziyashaik09 I've actually solved this problem.
Can you please share on how you address the issue? I tried the one provided on the original code, but it is not working. We would appreciate if you could give some ideas or if possible share the code. Thank you.
from big_vision.
It's not difficult. Change the model and tokenizer paths to your trained model
and tokenizer
path in the beginning and done. Although if you want to just keep the inference code that's slightly tricky. Since, PaliGemma uses Jax sharding which needs to be kept unless you can load the entire model on your GPU or Colab. @gadhane @Naziyashaik09
from big_vision.
@akolesnikoff actually no. Unfortunately, off-the boat it is not apparent we just need to change the model and tokenizer paths LOL!
from big_vision.
The main colab has examples of how to tune the model and make predictions (aka inference): https://colab.research.google.com/github/google-research/big_vision/blob/main/big_vision/configs/proj/paligemma/finetune_paligemma.ipynb.
Is there something specific that is unclear?
the dataset of fine-tuning paligemma is missing, and the longcap100 dataset is now inaccessible from kaggle.
from big_vision.
Related Issues (20)
- Error with putting arrays on CPU in cloud TPUs HOT 1
- How to save fine tuned PaliGemma model? HOT 3
- Can I convert paligemma npz model to pytorch to safetensors? HOT 3
- Implementation of contrast() seems wrong
- Behavior of `solarize()` depends on integer overflow
- No ChartQA ft weights released on Kaggle HOT 1
- PlaiGemma finetuned model HOT 1
- Loss Scale for Training Siglip
- [BUG] in big_vision.models.proj.flexi.vit HOT 1
- Reproduced result for flexivit HOT 2
- SigLIP and canonicalize
- Text lowering issue
- Negative rho values in GSAM training HOT 1
- FlexiVit is also flexible with image resolution?
- Load ViT with CLIPPO Weights HOT 2
- Mixup Per Example?
- Clarification: SigLIP Image Transform
- Errors in notebooks
- Confusion on FlexiViT
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from big_vision.