Support Anthropic messages API

[Swicegood]

Support Anthropic messages API

[ppipada]

Hi,

Have some bandwidth issue since quite some time, but given that this would be a easy improvement, I will try and look into it in a few days. Thanks for your patience.

[ppipada]

@Swicegood I have pushed a update to FlexiGPT today. 1.14.0

• New release also adds support for latest openai/claude/gemini/huggingface/llama.cpp changes.

Hope this solves your requirement.

[Swicegood]

Thank you for your effort, however I'm still getting:
`[ERROR] AxiosError: {
"type": "error",
"error": {
"type": "not_found_error",
"message": "Not Found"
}
}
404
{
"date": "Wed, 20 Mar 2024 20:15:43 GMT",
"content-type": "application/json",
"transfer-encoding": "chunked",
"connection": "close",
"x-should-retry": "false",
"request-id": "req_01UKsAjdMWoworvxAHfSyBMq",
"x-cloud-trace-context": "aafb1ebd010e813743d008068795f4ef",
"via": "1.1 google",
"cf-cache-status": "DYNAMIC",
"server": "cloudflare",
"cf-ray": "8678603add5505df-IAD"
}

Request failed with status code 404

`

[ppipada]

Can you please paste your settings: default provider, anthropicDefaultChatCompletionModel and anthropicDefaultCompletion model.

Also if possible, please also paste the FullRequest (please delete any visible secrets), this should be available in a dropdown below where you see the request. Same with response.

I myself have tested with Haiku model, but will try to reproduce with Opus based on your info.

[Swicegood]

Default provider: anthropic
Default Chat Completion Model: claude-3-opus-20240229
Default Completion Model: claude-3-opus-20240229
https://api.anthropic.com
{
"model": "claude-3-opus-20240229",
"prompt": null,
"messages": [
{
"role": "user",
"content": "hello"
}
],
"temperature": 0.1,
"maxTokens": 2048,
"limitContextLength": 2048,
"stream": false
}

[ppipada]

I tried opus too from my end:

Settings:

Conversation request:

Conversation response:

Reasons for your 404 (i.e page not found) for your api request I can guess for rechecking:

• "https://api.anthropic.com" should be accessible from your location for Opus. https://www.anthropic.com/supported-countries
• Your plan in Anthropic console should have access to new models
• Some intermittent issue with api access.

One more thing to check: Do you see any errors or suspicious in output window > FlexiGPT in VSCode

[Swicegood]

Strange. It works with curl and I'm in the US so country should'nt be an issue:
`curl https://api.anthropic.com/v1/messages
--header "x-api-key: $ANTHROPIC_API_KEY"
--header "anthropic-version: 2023-06-01"
--header "content-type: application/json"
--data
'{
"model": "claude-3-opus-20240229",
"max_tokens": 1024,
"messages": [
{"role": "user", "content": "Hello, Claude"}
]
}'

RESPONSE

{"id":"msg_01NnxrmGTfuyVUW8qe9ycU3C","type":"message","role":"assistant","content":[{"type":"text","text":"Hello! It's nice to meet you. How can I assist you today?"}],"model":"claude-3-opus-20240229","stop_reason":"end_turn","stop_sequence":null,"usage":{"input_tokens":10,"output_tokens":19}}% `

UPDATE: This from output appears to be the problem:

"url": "https://api.anthropic.com/v1/messages/v1/messages",
"method": "post",

[Swicegood]

Ok I changed that (didn't realize it was set one way in user and one way in workspace)
and now it's working. Thank you for your great work on this project!