Comments (3)
cc @ArthurZucker @younesbelkada
from transformers.
Hi @andysingal
Thanks for the issue ! In order for us to debug, can you make: https://huggingface.co/Andyrasika/Mistral7b-ORPO public?
from transformers.
Hi @andysingal Thanks for the issue ! In order for us to debug, can you make: https://huggingface.co/Andyrasika/Mistral7b-ORPO public?
I just deleted the repo on huggingface, here is the code i ran... using Runpod 3090 https://github.com/AIAnytime/ORPO-Mistral-7B-Alignment/blob/main/ORPO%20FT.ipynb
from transformers.
Related Issues (20)
- DDP error with load_best_model_at_end enabled
- Error while moving model to GPU `NotImplementedError: Cannot copy out of meta tensor; no data!` HOT 4
- KV cache with CPU offloading HOT 4
- Refusal rejection removal as a feature
- Add static cache support for Whisper HOT 3
- from_pretrained torch_dtype DO NOT affect model buffers
- Error with tf-keras when trying to geneate random seeds HOT 1
- Error while runing T5 trainer: TypeError: argument 'ids': 'list' object cannot be interpreted as an integer HOT 2
- Is `model. generate` supported during the training process?
- CLIPProcessor is not loading the saved Processor of the same version HOT 12
- Failed to Download GPT2-large Model from Hub
- Add TableTransformerImageProcessor HOT 3
- error when convert llama1 ckpts to hf formath HOT 5
- `hub_strategy="every_save"` won't push the model to the Hub if large
- Support for Multiple Datasets and Domain-Specific Loss Calculation in Trainer HOT 2
- AttributeError: 'HQQLinear' object has no attribute 'weight' HOT 8
- Assisted model doesn't seem to be working for Meta-Llama-3-8B HOT 2
- Mixtral past_key_values and output_router_logits incompatible HOT 1
- Disable Progress Bar? HOT 1
- Meet problems when I use the file src/transformers/models/llama/convert_llama_weights_to_hf.py to transfer LlaMa-7B HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from transformers.