Comments (4)
我们已经有计划,改造应用中的 provider实体和model实体的关系,来允许用户自定义provider,以及provider提供的models,这样最大限度适配市面上各个服务提供商的模型接口
from chatgpt-next-web.
https://github.com/ShinChven/vertex-ai-proxy
Vertex AI 只能用 Json api key,我写了个中继接口,可以临时解决一下 vertex AI token 刷新问题。
可以配置到 Next Chat 里面用。
from chatgpt-next-web.
Bot detected the issue body's language is not English, translate it automatically.
Title: [Feature Request]: Add gemini-1.5-pro interface through Ver
Problem Description
Currently, AI Studio does not give gemini-1.5-pro API permissions, but the vertex API is available.
The API calling methods of vertex API and AI Studio are different. You need to log in with Google Cloud SDK and obtain an access token to access.
I obtained the configuration information through the following script and have used gemini-1.5-pro on Next Chat.
API_ENDPOINT="us-central1-aiplatform.googleapis.com"
PROJECT_ID=<PROJECT_ID>
LOCATION_ID="us-central1"
MODEL_ID="gemini-1.5-pro-preview-0409"
ACCESS_TOKEN="$(gcloud auth print-access-token)"
URL="https://${API_ENDPOINT}/v1/projects/${PROJECT_ID}/locations/${LOCATION_ID}/publishers/google/models/${MODEL_ID}:streamGenerateContent"
echo "URL:"
echo ${URL}
echo "ACCESS TOKEN:"
echo ${ACCESS_TOKEN}
echo "MODEL_ID:"
echo ${MODEL_ID}
The specific configuration method of Next Chat is:
- Select Google as Model Provider
- Endpoint Address Fill in URL
- Fill in ACCESS_TOKEN for API Key
- API Version delete default
- Custom Model fill gemini-1.5-pro-preview-0409
Solution Description
I hope Next Chat can better support Vertex API.
Alternatives Considered
No response
Additional Context
No response
from chatgpt-next-web.
Bot detected the issue body's language is not English, translate it automatically.
We already have plans to transform the relationship between the provider entity and the model entity in the application to allow users to customize the provider and the models provided by the provider, so as to maximize the adaptability to the model interfaces of various service providers on the market.
from chatgpt-next-web.
Related Issues (20)
- 💻💡 零基础小白也能玩转科学上网和ChatGPT HOT 4
- [Bug] 面具功能中的以文搜图输出的是代码块, 并没有转化成图片 HOT 3
- ios pwa桌面图标问题 HOT 8
- [Bug] 如何使用OpenAI渠道调用Claude模型呢? HOT 5
- [Feature Request]: 希望增加一个开关可以关闭对用户输入内容的转义 HOT 2
- [Bug] Mac桌面端鼠标滑动问题 HOT 10
- [Bug] macOS APP中文输入法回车直接发送 HOT 9
- [Bug] code bypass vulnerability HOT 2
- [Feature Request]: 代理地址功能 HOT 3
- [Bug] Input Templates appear after each message HOT 2
- [Bug] 同步始终有问题,谢谢 HOT 16
- When you scroll up to a certain position and then click the mouse, it will automatically jump to the bottom.[Bug] HOT 2
- ChunkLoadError: Loading chunk 8029 failed.[Bug] HOT 4
- [Bug] openai新出的模型gpt-4-turbo-2024-04-09和gpt-4-turbo模型无法用视觉功能 HOT 3
- [Bug] Using 'yarn build' or 'npm build' causes the server to crash. HOT 3
- [Feat]Add Path var to disable the image upload function HOT 3
- [Bug] 聊天记录的快捷复制按钮自动隐藏无法点击 HOT 3
- [Bug] 使用gpt-4-turbo模型时 max_tokens设置大于4096就会报错 HOT 5
- [Bug] 自定义接口勾选取消后,接口调用仍然在使用自定义接口未使用服务中配置的baseurl HOT 5
- [Bug] issue HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from chatgpt-next-web.