Comments (7)
Seeing this too :/
from llm-engine.
Looking into it
from llm-engine.
So sorry about this, we changed the route path. Can you upgrade to version 0.0.0.b7 and try again? đ
from llm-engine.
Error still persists after upgrading to 0.0.0.b7
from llm-engine.
Hmm are you able to curl https://api.spellbook.scale.com/llm-engine/v1/llm/fine-tunes
? (This should give error 401 due to missing API key, not error 404.) The old URL https://api.spellbook.scale.com/v1/llm/fine-tunes
should also give 308, not 404 đ¤ I noticed that the URL in your error screenshot has an extra %5C
before the v1
; confused on where that is coming from
from llm-engine.
I'm going to close this out for now - @f-linus feel free to open if you're seeing the issue persist, after accounting for the backslash in the path.
from llm-engine.
Sorry for getting back on this only now. I think I know now what the issue is.
As you pointed out, the URL I mentioned had a backslash in it which makes the URL invalid. Now, this bags the question why did the URL have an backslash in it in the first place?
I think the answer lies in using the os.path.join method used here on line 99:
Most people are probably on a Mac or Linux where the os.path.join method joins strings by adding a normal slash. However when on Windows, the os.path.join method joins strings using a backslash. Since I'm on Windows right now, the URL created to call the API endpoint has a backslash in it where there actually should be a normal slash.
from llm-engine.
Related Issues (20)
- Fine-tuning API should return immediately with a clear error message if the input is invalid
- Can we fine tune with data stored in local csv file? HOT 9
- â ī¸ LLM Engine fine-tuning maintenance â ī¸ HOT 4
- GQA for Llama 2 7B and 13B models
- Investigate CUDA graphs
- RetNet adaptation
- Speculative decoding
- PEFT adapters with continuous batching
- Further reduction of pod cold start time
- Test out spot instances HOT 1
- Error: Internal Server Error: <class 'AttributeError'>: 'CreateFineTuneResponse' object has no attribute 'artifact_id' HOT 4
- Control frequency - completion HOT 3
- self host on runnpod HOT 1
- Add support for Mistral-7B in the Completions API HOT 2
- Add support for Mistral in the FineTune API
- Cannot pass in PEFT configs when creating a finetuning job HOT 4
- Integrate TensorRT-LLM
- Fine-Tuning LLM using Local GPU and Infra HOT 1
- Add Completions support for Llama 3 HOT 1
- how can we use glue dataset to llama2-7Bīŧ HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
đ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. đđđ
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google â¤ī¸ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from llm-engine.