Llama 3 70B Instruct Reference
Auto-regressive LLM with optimized transformers, SFT, and RLHF for alignment with helpfulness and safety preferences.
About model
Llama 3 70B Instruct Reference provides conversational AI capabilities, excelling at generating human-like responses to user input. Its key strength lies in following instructions and engaging in productive discussions, making it suitable for developers and businesses seeking advanced chat functionality.
API usage
Endpoint:
- TypeLLM
- Main use casesChat
- FeaturesJSON Mode
- DeploymentServerlessOn-Demand DedicatedMonthly Reserved
- Endpoint
- Parameters70B
- Context length8K
- Input price
$0.88 / 1M tokens
- Output price
$0.88 / 1M tokens
- Input modalitiesText
- Output modalitiesText
- ReleasedApril 17, 2024
- Quantization levelFP16
- External link
- CategoryChat