快速接入(兼容OpenAI格式)
from openai import OpenAI
client = OpenAI(
base_url="http://YOUR_SERVER_IP:8000/v1",
api_key="你的API Key",
)
response = client.chat.completions.create(
model="qwen3.5-9b",
messages=[{"role": "user", "content": "你好"}],
)
print(response.choices[0].message.content)
支持所有兼容OpenAI SDK的工具和框架