Comments (5)
I recommend using LocalAI as the backend to pair ShellGPT with custom or open-source LLMs, more details in README.md. Currently, ShellGPT has been optimized and tested only with the OpenAI backend. Therefore, I'm closing this issue. Thank you for your interest and feedback!
from shell_gpt.
It's a pity to hear that. This should be so easy to fix on shell_gpt
end.
The model I use is not self-hosted, it is OpenAI-compatible web service, so I do not see how LacalAI could solve the issue.
from shell_gpt.
It's a pity to hear that. This should be so easy to fix on shell_gpt end.
The model I use is not self-hosted, it is OpenAI-compatible web service, so I do not see how LacalAI could solve the issue.
I think the right way to resolve the issue in this case is to fix the response of your custom model/backend so it doesn't return empty choices
. Or just change ShellGPT code on your end to ignore empty choices
.
from shell_gpt.
I have no control on that backend.
And that response with empty choices is not an error, it also serves own purpose, bringing extra info in other fields.
Honestly I have no idea where exactly those extra fields (like prompt_filter_results
) are used, but as I see it - that is just minor extension over standard OpenAI output, and it would be great if such minor differences would not crash shell_gpt
.
It would have been beneficial for shell_gpt
to be robust in processing different data: in the end - that is all valid json, with correct structure.
from shell_gpt.
You can check yourself:
api base: https://one.caifree.com/v1
token: sk-oR2hYL4yYPeFKip96c6a8256C05d4d628bE7E526336718Ff
from shell_gpt.
Related Issues (20)
- [Feature]Enable vim in REPL mode
- Support streaming to pipe
- Do not force-wrap text when output to file (or piping)
- The results of executes are different
- how to let "function" framwork work for local model, not just for openAI?
- Better formatting in REPL
- I accidentally put the wrong api key, now I can't use it? HOT 1
- Why there are no output?
- Test failure on Python 3.12
- [Feature] Single stroke reaction confirmation in shell mode
- Feature request: add support for Perplexity API HOT 2
- [Contribution] ZSH Completion file HOT 1
- `--create-role` should allow empty role descriptions
- Generate `--repl` and `--chat` tags automatically HOT 2
- Please support claude.ai HOT 8
- Removing `DEFAULT_MODEL` from the `.sgptrc` file, ends up re-writing the whole file
- BadRequestError: 400 Bad Request HOT 1
- lmstudio ? HOT 1
- Unable to use OpenAI API key HOT 2
- Don't align markdown titles to the center, but to the left HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from shell_gpt.