This website uses cookies to anonymously analyze website traffic using Google Analytics.

Models / Mistral AIMixtral /  / Mixtral 8x7B v0.1 API

Mixtral 8x7B v0.1 API

Pretrained generative Sparse Mixture of Experts.

Request deployment

This model is currently only available for Monthly Reserved deployments.

Please request a deployment to get started.

Mixtral 8x7B v0.1 API Usage

Endpoint

RUN INFERENCE

curl -X POST "https://api.together.xyz/v1/completions" \
  -H "Authorization: Bearer $TOGETHER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama-llama-2-70b-hf",
    "prompt": "",
    "stream": true
  }'

RUN INFERENCE

from together import Together

client = Together()
response = client.completions.create(
    model="meta-llama-llama-2-70b-hf",
    prompt="",
    stream=True
)
for token in response:
    if hasattr(token, 'choices'):
        print(token.choices[0].delta.content, end='', flush=True)

RUN INFERENCE

import Together from "together-ai";

const together = new Together();

const response = await together.completions.create({
  model: "meta-llama-llama-2-70b-hf",
  prompt: "",
  stream: true
});
for await (const token of response) {
  console.log(token.choices[0]?.delta?.content)
}

How to use Mixtral 8x7B v0.1

Model details

Prompting Mixtral 8x7B v0.1

Applications & Use Cases

Looking for production scale? Deploy on a dedicated endpoint

Deploy Mixtral 8x7B v0.1 on a dedicated endpoint with custom hardware configuration, as many instances as you need, and auto-scaling.

Get started