Models / Chat / NIM Mixtral 8x22B Instruct v0.1 API
NIM Mixtral 8x22B Instruct v0.1 API
Chat
NVIDIA NIM for GPU accelerated Mixtral 8x22B Instruct inference through OpenAI compatible APIs.
Deploy this NIM model
API Usage
How to use NIM Mixtral 8x22B Instruct v0.1Model CardPrompting NIM Mixtral 8x22B Instruct v0.1Applications & Use CasesNIM Mixtral 8x22B Instruct v0.1 API Usage
Endpoint
nim/mistralai/mixtral-8x22b-instruct-v01
RUN INFERENCE
This model is available as a Together Dedicated Endpoints deployment.
Follow our Docs to configure an endpoint via our API or CLI.JSON RESPONSE
RUN INFERENCE
This model is available as a Together Dedicated Endpoints deployment.
Follow our Docs to configure an endpoint via our API or CLI.JSON RESPONSE
RUN INFERENCE
This model is available as a Together Dedicated Endpoints deployment.
Follow our Docs to configure an endpoint via our API or CLI.JSON RESPONSE
Model Provider:
Meta
Type:
Chat
Variant:
Instruct
Parameters:
141B
Deployment:
✔️ Dedicated
Quantization
Context length:
65536
Pricing:
Run in playground
Deploy model
Quickstart docs
Quickstart docs
How to use NIM Mixtral 8x22B Instruct v0.1
Model details
Prompting NIM Mixtral 8x22B Instruct v0.1
Applications & Use Cases
Looking for production scale? Deploy on a dedicated endpoint
Deploy NIM Mixtral 8x22B Instruct v0.1 on a dedicated endpoint with custom hardware configuration, as many instances as you need, and auto-scaling.
