dashscope_to_openai's Introduction

Dashscope_to_openai

将阿里巴巴开源模型的Dashscope api 转换成Openai格式进行调用

注：这是一段魔改代码，改自Qwen/openai_api.py，为测试阿里云开源模型，只能进行最基本的非流式输出和流式输出进行对话，如有精力会继续更新

开始前请先安装必要的代码库

pip install fastapi uvicorn openai==0.28.0 pydantic sse_starlette dashscope

在终端运行代码

python dashscope_to_openai.py

使用API

import openai
openai.api_base = "http://localhost:8000/v1"
openai.api_key = "none"

# 使用流式回复的请求
for chunk in openai.ChatCompletion.create(
    model="Qwen",
    messages=[
        {"role": "user", "content": "你好"}
    ],
    stream=True
    # 流式输出的自定义stopwords功能尚未支持
):
    if hasattr(chunk.choices[0].delta, "content"):
        print(chunk.choices[0].delta.content, end="", flush=True)

# 不使用流式回复的请求
response = openai.ChatCompletion.create(
    model="Qwen",
    messages=[
        {"role": "user", "content": "你好"}
    ],
    stream=False
)
print(response.choices[0].message.content)

dashscope_to_openai's People

Contributors

Stargazers

Watchers

dashscope_to_openai's Issues

这个好像不是最新的openai调用方式，运行会报错

import openai

# optional; defaults to `os.environ['OPENAI_API_KEY']`
openai.api_key = '...'

# all client options can be configured just like the `OpenAI` instantiation counterpart
openai.base_url = "https://..."
openai.default_headers = {"x-foo": "true"}

completion = openai.chat.completions.create(
    model="gpt-4",
    messages=[
        {
            "role": "user",
            "content": "How do I output all files in a directory using Python?",
        },
    ],
)
print(completion.choices[0].message.content)

最新的调用方式OpenAI

Recommend Projects