1.接口描述

2.请求参数

2.1请求头参数

2.2请求参数

备注：此参数为全平台模型通用，每个模型支持的参数、参数范围可能因模型不同而有所差异，详细可见模型广场内每个模型的API文档。

请求参数示例

{
  "model": "1234567890",    // 模型ID
  "messages": [
    {
      "role": "user",
      "content": "Hello!"
    }
  ]
}

3.请求返回

3.1非流式返回

3.1.1非流式正常返回

返回结果示例

{
  "id": "chatcmpl-123",
  "object": "chat.completion",
  "created": 1677652288,
  "model": "xxx-chat",
  "choices": [{
    "index": 0,
    "finish_reason": "stop",
    "message": {
      "role": "assistant",
      "content": "\n\nHello there, how may I assist you today?"
    }
  }],
  "usage": {
    "prompt_tokens": 9,
    "completion_tokens": 12,
    "total_tokens": 21
  }
}

3.1.2 非流式异常返回

非流式异常返回时：

● http code 返回非200。

● http body 中返回 error 结构，error结构中包含code、type、message、param等信息，具体可见OpenAPI接口文档中的error结构描述及错误码部分介绍。

错误结果示例

{
  "error" : {
    "code" : "500001",
    "type" : "INVOKE_MODEL_ERROR",
    "message" : "服务接口异常，请联系管理员"
  }
}

3.2 流式返回

3.2.1 流式正常返回

返回结果示例

{"id":"chatcmpl-123","object":"chat.completion.chunk","created":1694268190,"model":"xxx-chat", "choices":[{"index":0,"delta":{"role":"assistant"},"finish_reason":null}]}
{"id":"chatcmpl-123","object":"chat.completion.chunk","created":1694268190,"model":"xxx-chat", "choices":[{"index":0,"delta":{"content":"Hello"},"finish_reason":null}]}
....
{"id":"chatcmpl-123","object":"chat.completion.chunk","created":1694268190,"model":"xxx-chat", "choices":[{"index":0,"delta":{},"finish_reason":"stop"}]}

stream_options.include_usage 为 True 时多返回一条包含usage流式消息。

{"id":"chatcmpl-123","object":"chat.completion.chunk","created":1694268199,"model":"xxx-chat", "choices":[], "usage": {"prompt_tokens": 9,"completion_tokens": 120,"total_tokens": 129}}

3.2.2 流式异常返回

流式异常分为两种：

● 如果在流式请求接收处理之前发生了异常，如鉴权、参数校验等问题，与普通的非流式一样返回http code，并带有error结构。

● 如果在流式请求已经接收，会先对外返回流式请求连接建立的信息，此时http code为200，而在后续模型流式返回过程中发生了异常，会在流失返回的chunk返回error结构，并终止当前的流式请求。

流式请求建立后的异常返回示例

{"id":"chatcmpl-123","object":"chat.completion.chunk","created":1694268190,"model":"xxx-chat", "choices":[{"index":0,"delta":{"role":"assistant"},"finish_reason":null}]}
{"id":"chatcmpl-123","object":"chat.completion.chunk","created":1694268190,"model":"xxx-chat", "choices":[{"index":0,"delta":{"content":"Hello"},"finish_reason":null}]}
....
{"error":{"code":"500001","type":"INVOKE_MODEL_ERROR","message":"服务接口异常，请联系管理员"}}

4.请求示例代码

假设慧聚平台用户组AppKey=884c8fc4054548a7b1ca1123592f5b7，模型ID=96dcaaaaaaaaaaaa5ff55ea377831a，以此为例进行说明。

4.1 curl方式请求

curl --request POST \
  --url https://wishub-x1.ctyun.cn/v1/chat/completions \
  --header 'Accept: */*' \
  --header 'Accept-Encoding: gzip, deflate, br' \
  --header 'Authorization: Bearer 884c8fc4054548a7b1ca1123592f5b7' \
  --header 'Content-Type: application/json' \
  --data '{
        "model": "96dcaaaaaaaaaaaa5ff55ea377831a",
        "messages": [
                {
                        "role": "user",
                        "content": "Hello"
                }
        ]
}'

4.2 python方式请求

import json
import requests
URL = "https://wishub-x1.ctyun.cn/v1/chat/completions"
headers = {
    "Authorization": "Bearer 884c8fc4054548a7b1ca1123592f5b7",
    "Content-Type": "application/json"
}
data = {
    "model": "96dcaaaaaaaaaaaa5ff55ea377831a",
    "messages": [
        {"role": "user", "content": "Hello"}
    ],
    "stream": True
}
try:
    response = requests.post(URL, headers=headers, json=data, stream=True)
    if response.status_code != 200:
        print(response.json())
    else:
        # 流式
        for line in response.iter_lines(chunk_size=8192, decode_unicode=True):
            ## 处理请求
        # 非流式直接处理
        message = response.json()["choices"][0]["message"]["content"]
except Exception as e:
    print(f"Exception: {e}")

4.3 openai 客户端示例代码

import openai
from openai import OpenAI
client = OpenAI(base_url="https://wishub-x1.ctyun.cn/v1", api_key="884c8fc4054548a7b1ca1123592f5b7")
messages = [
    {"role": "user", "content": "Hello"}
]
try:
    stream = client.chat.completions.create(
        model="96dcaaaaaaaaaaaa5ff55ea377831a",
        messages=messages,
        stream=True 
    )
    # 流式
    for chunk in stream:
        print(chunk.choices[0].delta.content or "", end="", flush=True)
except openai.APIStatusError as e:
    print(f"APIStatusError: {e.status_code}, {e.message}, {e.body}")
except openai.APIError as e:
    print(f"APIError: {e.body}")
except Exception as e:
    print(f"Exception: {e}")