NIM Llama 3.1 70B Instruct
NVIDIA NIM for GPU accelerated Llama 3.1 70B Instruct inference through OpenAI compatible APIs.
About model
NVIDIA NIM serves Meta's Llama 3.1 70B Instruct for enterprise deployment, offering instruct-tuned language understanding and generation capabilities. It excels at following instructions and producing coherent text. Designed for enterprise use cases.
To run this model, you first need to deploy it on a Dedicated Endpoint.
Related models
- TypeChat
- Main use casesMedium General Purpose
- DeploymentOn-Demand DedicatedMonthly Reserved
- Parameters70B
- Context length128K
- Input modalitiesText
- Output modalitiesText
- ReleasedJuly 22, 2024
- External link
- CategoryChat