Together AI | Llama 3.1 Nemotron 70B Instruct API

This website uses cookies to anonymously analyze website traffic using Google Analytics.

Llama 3.1 Nemotron 70B Instruct API Usage

Endpoint

nvidia/Llama-3.1-Nemotron-70B-Instruct-HF

RUN INFERENCE

curl -X POST "https://api.together.xyz/v1/chat/completions" \
  -H "Authorization: Bearer $TOGETHER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "nvidia/Llama-3.1-Nemotron-70B-Instruct-HF",
    "messages": [],
    "stream": true
  }'

RUN INFERENCE

from together import Together

client = Together()

response = client.chat.completions.create(
    model="nvidia/Llama-3.1-Nemotron-70B-Instruct-HF",
    messages=[],
    stream=True
)
for token in response:
    if hasattr(token, 'choices'):
        print(token.choices[0].delta.content, end='', flush=True)

RUN INFERENCE

import Together from "together-ai";

const together = new Together();

const response = await together.chat.completions.create({
  messages: [],
  model: "nvidia/Llama-3.1-Nemotron-70B-Instruct-HF",
  stream: true
});

for await (const token of response) {
  console.log(token.choices[0]?.delta?.content)
}

Subscribe to newsletter

Thank you! Your submission has been received!

Oops! Something went wrong while submitting the form.