Mistral Small 4 119B MoE model with NVFP4 quantization, supporting 262K context, Function Calling and Vision. Alias: mistral-medium-35
mistral-medium-35| 模型 ID | mistral-medium-35 |
|---|---|
| 模型名稱 | Mistral Small 4 (119B) |
| 說明 | Mistral Small 4 119B MoE model with NVFP4 quantization, supporting 262K context, Function Calling and Vision. Alias: mistral-medium-35 |
| 相關連結 | https://huggingface.co/mistralai/Mistral-Small-4-119B-2603 |
from openai import OpenAI
client = OpenAI(
api_key="YOUR_API_KEY",
base_url="https://api.ithu.tw/v1",
)
response = client.chat.completions.create(
model="mistral-medium-35",
messages=[
{"role": "system", "content": "You are a helpful assistant."},
{"role": "user", "content": "Hello!"}
]
)
print(response.choices[0].message.content)