NIM Mixtral 8x22B Instruct v0.1
NVIDIA NIM for GPU accelerated Mixtral 8x22B Instruct inference through OpenAI compatible APIs.
About model
NIM Mixtral 8x22B Instruct v0.1 serves high-capacity mixture-of-experts capabilities via NVIDIA Inference Microservices. It specializes in handling complex tasks with its large capacity. Suitable for advanced users requiring high-performance language understanding.
To run this model, you first need to deploy it on a Dedicated Endpoint.
- TypeChat
- Main use casesMedium General Purpose
- DeploymentOn-Demand DedicatedMonthly Reserved
- Parameters141B
- Context length65536
- Input modalitiesText
- Output modalitiesText
- ReleasedJune 5, 2024
- External link
- CategoryChat