Models / Chat / Qwen3 235B A22B FP8 Throughput API
Qwen3 235B A22B FP8 Throughput API
Chat
Reasoning
Hybrid instruct + reasoning model (232Bx22B MoE) optimized for high-throughput, cost-efficient inference and distillation.
Try our Qwen3 API
API Usage
How to use Qwen3 235B A22B FP8 ThroughputModel CardPrompting Qwen3 235B A22B FP8 ThroughputApplications & Use CasesHow to use Qwen3 235B A22B FP8 ThroughputQwen3 235B A22B FP8 Throughput API Usage
Endpoint
Qwen/Qwen3-235B-A22B-fp8-tput
RUN INFERENCE
curl -X POST "https://api.together.xyz/v1/chat/completions" \
-H "Authorization: Bearer $TOGETHER_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "Qwen/Qwen3-235B-A22B-fp8-tput",
"messages": [],
"stream": true
}'JSON RESPONSE
RUN INFERENCE
from together import Together
client = Together()
response = client.chat.completions.create(
model="Qwen/Qwen3-235B-A22B-fp8-tput",
messages=[],
stream=True
)
for token in response:
if hasattr(token, 'choices'):
print(token.choices[0].delta.content, end='', flush=True)JSON RESPONSE
RUN INFERENCE
import Together from "together-ai";
const together = new Together();
const response = await together.chat.completions.create({
messages: [],
model: "Qwen/Qwen3-235B-A22B-fp8-tput",
stream: true
});
for await (const token of response) {
console.log(token.choices[0]?.delta?.content)
}JSON RESPONSE
Model Provider:
Qwen
Type:
Chat
Variant:
Parameters:
235B
Deployment:
✔ Serverless
✔️ On-Demand Dedicated
Quantization
FP8
Context length:
128K
Pricing:
$0.20 Input / $0.60 Output
Check pricing
Run in playground
Deploy model
Quickstart docs
Quickstart docs
How to use Qwen3 235B A22B FP8 Throughput
Model details
Prompting Qwen3 235B A22B FP8 Throughput
Applications & Use Cases
How to use Qwen3 235B A22B FP8 Throughput
Looking for production scale? Deploy on a dedicated endpoint
Deploy Qwen3 235B A22B FP8 Throughput on a dedicated endpoint with custom hardware configuration, as many instances as you need, and auto-scaling.
