⚡️ FlashAttention-4: up to 1.3× faster than cuDNN on NVIDIA Blackwell →

Introducing Together AI's new look →

🔎 ATLAS: runtime-learning accelerators delivering up to 4x faster LLM inference →

⚡ Together GPU Clusters: self-service NVIDIA GPUs, now generally available →

📦 Batch Inference API: Process billions of tokens at 50% lower cost for most models →

🪛 Fine-Tuning Platform Upgrades: Larger Models, Longer Contexts →

Models / Meta
Chat

NIM Mixtral 8x7B Instruct v0.1

NVIDIA NIM for GPU accelerated Mixtral 8x7B Instruct inference through OpenAI compatible APIs.

Deploy this NIM model
read docs

About model

NIM Mixtral 8x7B Instruct v0.1 serves as a mixture-of-experts model, providing specialized instruction-based responses. It is suited for applications requiring precise and informative outputs. Developed by Mistral, it is available via NVIDIA Inference Microservices.

To run this model, you first need to deploy it on a Dedicated Endpoint.

    Related models
    new
    Chat
    NVIDIA Nemotron 3 Super
    • Parameters
      120B
    • Deployment
      Dedicated Inference
    No items found.
    Code
    Chat
    new
    Chat
    MiniMax M2.5
    • Input/1M
      $0.30
    • Output/1M
      $1.20
    • Parameters
      228.7B
    Function Calling
    JSON Mode
    Reasoning
    Code
    New
    Chat
    Qwen3.5 9B
    • Input/1M
      $0.10
    • Output/1M
      $0.15
    • Parameters
      9B
    Function Calling
    JSON Mode
    Reasoning
    Vision
    Chat
    Model specifications
    Model data
    • Model provider
      Meta
    • Type
      Chat
    • Main use cases
      Small & Fast
    • Deployment
      On-Demand Dedicated
      Monthly Reserved
    • Parameters
      46B
    • Context length
      32768
    • Input modalities
      Text
    • Output modalities
      Text
    Quickstart docs
    Deploy model