xinference、glm4工具调用报错400

[JinCheng666]

xinference、glm4工具调用报错400

[slot181]

我发现用 claude 也有这个问题。

fastgpt | message: '400 messages: roles must alternate between "user" and "assistant", but found multiple "user" roles in a row (request id: 2024062912300280418215164311064)',
fastgpt | stack: 'Error: 400 messages: roles must alternate between "user" and "assistant", but found multiple "user" roles in a row (request id: 2024062912300280418215164311064)\n' +
fastgpt | ' at eL.generate (/app/projects/app/.next/server/chunks/76750.js:15:67594)\n' +
fastgpt | ' at av.makeStatusError (/app/projects/app/.next/server/chunks/76750.js:15:79337)\n' +
fastgpt | ' at av.makeRequest (/app/projects/app/.next/server/chunks/76750.js:15:80260)\n' +
fastgpt | ' at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n' +
fastgpt | ' at async Object.P [as chatNode] (/app/projects/app/.next/server/chunks/75612.js:312:686)\n' +
fastgpt | ' at async k (/app/projects/app/.next/server/chunks/75612.js:313:2241)\n' +
fastgpt | ' at async Promise.all (index 5)\n' +
fastgpt | ' at async E (/app/projects/app/.next/server/chunks/75612.js:313:2782)\n' +
fastgpt | ' at async C (/app/projects/app/.next/server/pages/api/v1/chat/completions.js:63:11920)\n' +
fastgpt | ' at async /app/projects/app/.next/server/pages/api/core/app/list.js:1:5593'
fastgpt | }
fastgpt | [Info] 2024-06-29 10:30:03 Request finish /api/v1/chat/completions, time: 1195ms

[c121914yu]

我发现用 claude 也有这个问题。

fastgpt | message: '400 messages: roles must alternate between "user" and "assistant", but found multiple "user" roles in a row (request id: 2024062912300280418215164311064)',
fastgpt | stack: 'Error: 400 messages: roles must alternate between "user" and "assistant", but found multiple "user" roles in a row (request id: 2024062912300280418215164311064)\n' +
fastgpt | ' at eL.generate (/app/projects/app/.next/server/chunks/76750.js:15:67594)\n' +
fastgpt | ' at av.makeStatusError (/app/projects/app/.next/server/chunks/76750.js:15:79337)\n' +
fastgpt | ' at av.makeRequest (/app/projects/app/.next/server/chunks/76750.js:15:80260)\n' +
fastgpt | ' at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n' +
fastgpt | ' at async Object.P [as chatNode] (/app/projects/app/.next/server/chunks/75612.js:312:686)\n' +
fastgpt | ' at async k (/app/projects/app/.next/server/chunks/75612.js:313:2241)\n' +
fastgpt | ' at async Promise.all (index 5)\n' +
fastgpt | ' at async E (/app/projects/app/.next/server/chunks/75612.js:313:2782)\n' +
fastgpt | ' at async C (/app/projects/app/.next/server/pages/api/v1/chat/completions.js:63:11920)\n' +
fastgpt | ' at async /app/projects/app/.next/server/pages/api/core/app/list.js:1:5593'
fastgpt | }
fastgpt | [Info] 2024-06-29 10:30:03 Request finish /api/v1/chat/completions, time: 1195ms

claude 没支持函数调用

[JinCheng666]

更新xinference到0.12.3，仍然出现这个问题

[romejiang]

更新xinference到0.12.3，仍然出现这个问题
将这两个参数改成false
config.json

  "toolChoice": false,
  "functionCall": false,

[hellolixy]

解决了吗？我在xinference上部署了qw2-7b模型， 也是报这个错，但是dify上使用是正常的：
message: '400 status code (no body)',
stack: 'Error: 400 status code (no body)\n' +
' at APIError.generate (webpack-internal:///(api)/../../node_modules/.pnpm/[email protected][email protected]/node_modul
ror.mjs:57:20)\n' +
' at OpenAI.makeStatusError (webpack-internal:///(api)/../../node_modules/.pnpm/[email protected][email protected]/node_
ai/core.mjs:292:65)\n' +
' at OpenAI.makeRequest (webpack-internal:///(api)/../../node_modules/.pnpm/[email protected][email protected]/node_modu
ore.mjs:335:30)\n' +
' at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n' +
' at async runToolWithToolChoice (webpack-internal:///(api)/../../packages/service/core/workflow/dispatch/agent/run
ice.ts:95:24)\n' +