Model Details
DiffusionGemma-26B
首款擴散架構語言模型,單 GPU 702 tok/s,262K 上下文,支援 Tool Calling
API Usage
Use model ID:
diffusiongemma-26b首款擴散架構語言模型,單 GPU 702 tok/s,262K 上下文,支援 Tool Calling
diffusiongemma-26b| Model ID | diffusiongemma-26b |
|---|---|
| Model Name | DiffusionGemma-26B |
| Description | 首款擴散架構語言模型,單 GPU 702 tok/s,262K 上下文,支援 Tool Calling |
| Related Link | https://huggingface.co/google/diffusiongemma-26B-A4B-it |
from openai import OpenAI
client = OpenAI(
api_key="YOUR_API_KEY",
base_url="https://api.ithu.tw/v1",
)
response = client.chat.completions.create(
model="diffusiongemma-26b",
messages=[
{"role": "system", "content": "You are a helpful assistant."},
{"role": "user", "content": "Hello!"}
]
)
print(response.choices[0].message.content)