Comments (4)
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.
Please note that issues that do not follow the contributing guidelines are likely to be ignored.
from transformers.
I just had the same error, it happened when saving weights at end of epoch. Any suggestion?
from transformers.
Hey! Could you give a bit more details about the transformers version you are using / accelerate version ets:
transformers-cli env
should output that
from transformers.
@ArthurZucker thanks for taking a look! I was trying to fine-tune the model of idefic2, I also tried all transformer versions that enables idefics and none of them worked. The training loss looks all good. I found discussions here but (1) try more new trainings (2)set the timeout value to a much bigger number both failed(by failure in 2 I let it run for ~12 hours and still does not go to epoch 2).
- `transformers` version: 4.44.0.dev0
- Platform: Linux-5.10.0-31-cloud-amd64-x86_64-with-glibc2.29
- Python version: 3.8.10
- Huggingface_hub version: 0.24.2
- Safetensors version: 0.4.3
- Accelerate version: 0.33.0
- Accelerate config: not found
- PyTorch version (GPU?): 2.4.0+cu121 (True)
- Tensorflow version (GPU?): not installed (NA)
- Flax version (CPU?/GPU?/TPU?): not installed (NA)
- Jax version: not installed
- JaxLib version: not installed
- Using distributed or parallel set-up in script?: <fill in>
- Using GPU in script?: <fill in>
- GPU type: NVIDIA A100-SXM4-80GB
from transformers.
Related Issues (20)
- [whisper] setting `prompt_condition_type="all-segments"` results in generation errors when `prompt_ids` is set HOT 1
- PreTrainedTokenizerFast `char_to_token` `token_to_char` not working as expected
- Llama3 Tokenizer Decode Removing Space Character HOT 1
- Gradient checkpointing warning HOT 1
- Gemma2 GGUF: `modeling_gguf_pytorch_utils.py: ValueError: Architecture gemma2 not supported` HOT 3
- [Bug] RT-DETR post-processing yields incorrect results when use_focal_loss=False HOT 1
- apply_rotary_pos_emb() Tensor size mismatch HOT 6
- Invalid attention causal mask within the Llama model ?
- Shape mismatch when generating with multiple processes HOT 2
- [RT-DETR] No norm freezing for R18 HOT 6
- Significant Performance Discrepancy Between Single-GPU and Multi-GPU Training with BERT HOT 2
- End-to-end generation compile cannot work !!! HOT 1
- Static Cache is broken with multi-gpu inference HOT 2
- Docker container with development environment for Transformers library HOT 2
- PaliGemmaForConditionalGeneration example script not working (AutoProcessor) HOT 4
- Removing last element of class_queries_logits is not appropriate when do_reduce_labels is set to false. HOT 1
- Out of memory when using phi3 for token classification HOT 1
- Odd output from falcon-mamba-7b on mps device HOT 2
- Clarification on saving model checkpoints
- Can MPS use FP16 when training?Why I can't? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from transformers.