[bug] Hosted Gorilla: <Issue>

[Marcseb]

[bug] Hosted Gorilla:

from gorilla.

[Marcseb]

Thank you very much Shishir for your prompt response. I was indeed anticipating too much the migration to a newer openai version. Thanks also for the colab with the example of integration with Langchain.

…

________________________________ Da: Shishir Patil ***@***.***> Inviato: venerdì 5 aprile 2024 08:31 A: ShishirPatil/gorilla ***@***.***> Cc: Marcseb ***@***.***>; Mention ***@***.***> Oggetto: Re: [ShishirPatil/gorilla] [bug] Hosted Gorilla: <Issue> (Issue #312) Hey @Marcseb<https://github.com/Marcseb> I just tried it out, and looks like I can hit our endpoints for the given model. Can you try with openai==0.28.xx ? Here's a colab notebook if that helps: https://colab.research.google.com/drive/11HJWR3ylG1HSE2v78W1gRK-dKkSA0pHe?usp=sharing — Reply to this email directly, view it on GitHub<#312 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/APZ4ELD6XCXMJV3NJKSNZODY3ZOODAVCNFSM6AAAAABFX3MOPSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMZZGI2DCNJQGM>. You are receiving this because you were mentioned.Message ID: ***@***.***>

[ShishirPatil]

Hey @Marcseb I just tried it out, and looks like I can hit our endpoints for the given model. Can you try with openai==0.28.xx ?

Here's a colab notebook if that helps: https://colab.research.google.com/drive/11HJWR3ylG1HSE2v78W1gRK-dKkSA0pHe?usp=sharing

[sepiatone]

Hey @Marcseb I just tried it out, and looks like I can hit our endpoints for the given model. Can you try with openai==0.28.xx ?

Here's a colab notebook if that helps: https://colab.research.google.com/drive/11HJWR3ylG1HSE2v78W1gRK-dKkSA0pHe?usp=sharing

@ShishirPatil

There has been some refactoring of the LangChain code earlier this year - the code should be as follows:

from langchain_openai import ChatOpenAI
chat_model = ChatOpenAI(
    openai_api_base="http://zanino.millennium.berkeley.edu:8000/v1",
    openai_api_key="EMPTY",
    model="gorilla-7b-hf-v1",
    verbose=True
)

and the prompt

example = chat_model.invoke("I want to translate from English to Chinese")
print(example.content)

I checked with the latest version of openai 1.23.6 at it works fine.

I've opened a PR #400 to update the blog post.