Comments (8)
As a quick fix for this. On version 0.5.0, I was able to get around this error by commenting out line 2572
in modeling_utils.py
(see this fork of transformers):
Replace:
folder = os.path.sep.join(resolved_archive_file[0].split(os.path.sep)[:-1])
with
#folder = os.path.sep.join(resolved_archive_file[0].split(os.path.sep)[:-1])
I'm unsure if this fix will have repercussions later down the line, however, for the time being it seems to be working.
from detoxify.
Hey all, thanks for raising this and good to see there's a workaround!
We will look into this asap!
from detoxify.
It is working for me with version 4.24.0, the next version however raises this error.
I believe it comes from this specific PR on transformers library merged in 4.25.1 huggingface/transformers#20321
However, it's not clear for me if this is an expected behavior on tranformers' side or if they introduced a bug
from detoxify.
Me too... python 3.8 on Linux. Maybe this is related to the latest release? It worked fine before.
from detoxify.
As a quick fix for this. On version 0.5.0, I was able to get around this error by commenting out line
2572
inmodeling_utils.py
(see this fork of transformers):Replace:
folder = os.path.sep.join(resolved_archive_file[0].split(os.path.sep)[:-1])
with#folder = os.path.sep.join(resolved_archive_file[0].split(os.path.sep)[:-1])
I'm unsure if this fix will have repercussions later down the line, however, for the time being it seems to be working.
thank you, this work for me as well!
from detoxify.
As a workaround, the v4.22.1
release of transformers
appears to work as expected. So if installing via pip:
pip install detoxify
pip install transformers==4.22.1
(Other versions between the latest release and v4.22.1
may also work)
from detoxify.
Hey everyone, pinned the transformers version to 4.22.1 as a quick fix for now as we investigate this problem further, everything should hopefully work as expected if you reinstall the package/upgrade the transformers version!
from detoxify.
It is apparently a bug on transformers side, and it should be fixed in next release with this PR: huggingface/transformers#21542
If you need a solution right now, you can also install transformers from their main branch directly, the PR is merged already
from detoxify.
Related Issues (20)
- Pinpoint the parts of the speech that trigger high values
- OSError: Unable to load vocabulary from file. Please check that the provided vocabulary is accessible and not corrupted. HOT 1
- Number of epochs to get the best model HOT 2
- Progress Bar HOT 5
- UnicodeDecodeError when installing from git
- Add dutch language HOT 1
- Question regards use case HOT 1
- Question - Adding additional models and labels. HOT 1
- Question regards training with other models HOT 1
- Error during training HOT 1
- Multi GPU predict
- Add license information for toxic-bert on HF HOT 7
- Converting model to AWS Inferentia hardware using Optimum-cli
- FileNotFoundError: [Errno 2] No such file or directory: 'jigsaw_data/jigsaw-toxic-comment-classification-challenge/val.csv'
- What are the max token lengths for the models?
- Error on PIP install HOT 6
- Bump up Transformers version HOT 2
- "torch" error by just importing Detoxify HOT 1
- OSError: None is not a local folder and is not a valid model identifier listed on 'https://huggingface.co/models' HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from detoxify.