Models / Chat / Refuel LLM-2 Small API
Refuel LLM-2 Small API
Chat
8B model optimized for data tasks such as classification, structured data extraction, and more.
Try our Refuel LLM-2 Small API
New
API Usage
How to use Refuel LLM-2 SmallModel CardPrompting Refuel LLM-2 SmallApplications & Use CasesRefuel LLM-2 Small API Usage
Endpoint
togethercomputer/Refuel-Llm-V2-Small
RUN INFERENCE
curl -X POST "https://api.together.xyz/v1/chat/completions" \
-H "Authorization: Bearer $TOGETHER_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "togethercomputer/Refuel-Llm-V2-Small",
"messages": [
{
"role": "user",
"content": "Clean this address: 251 Rhd Is St, SF, CA 94107"
}
],
"stream": true
}'JSON RESPONSE
RUN INFERENCE
from together import Together
client = Together()
response = client.chat.completions.create(
model="togethercomputer/Refuel-Llm-V2-Small",
messages=[
{
"role": "user",
"content": "Clean this address: 251 Rhd Is St, SF, CA 94107"
}
],
stream=True
)
for chunk in response:
print(chunk.choices[0].delta.content or "", end="")JSON RESPONSE
RUN INFERENCE
import Together from "together-ai";
const together = new Together();
const stream = await together.chat.completions.create({
model: "togethercomputer/Refuel-Llm-V2-Small",
messages: [
{
role: "user",
content: "Clean this address: 251 Rhd Is St, SF, CA 94107"
}
],
stream: true
});
for await (const chunk of stream) {
process.stdout.write(chunk.choices[0].delta.content || "");
}
JSON RESPONSE
Model Provider:
Refuel
Type:
Chat
Variant:
Parameters:
8B
Deployment:
✔️ Serverless
Quantization
Context length:
8K
Pricing:
$0.20
Run in playground
Deploy model
Quickstart docs
Quickstart docs
How to use Refuel LLM-2 Small
Model details
Prompting Refuel LLM-2 Small
Applications & Use Cases
Looking for production scale? Deploy on a dedicated endpoint
Deploy Refuel LLM-2 Small on a dedicated endpoint with custom hardware configuration, as many instances as you need, and auto-scaling.
