This website uses cookies to anonymously analyze website traffic using Google Analytics.
AcceptDecline

Models / Chat / Llama 3 70B Instruct Turbo API

Llama 3 70B Instruct Turbo API

LLM

Auto-regressive LLM with optimized transformers, SFT, and RLHF for alignment with helpfulness and safety preferences.

Try our Llama 3 API
API Usage
How to use Llama 3 70B Instruct TurboModel CardPrompting Llama 3 70B Instruct TurboApplications & Use Cases

Llama 3 70B Instruct Turbo API Usage

Endpoint

meta-llama/Meta-Llama-3-70B-Instruct-Turbo
Curl
Python
Typescript

RUN INFERENCE

RUN INFERENCE

RUN INFERENCE

How to use Llama 3 70B Instruct Turbo

Model details

Prompting Llama 3 70B Instruct Turbo

Applications & Use Cases

Model Provider:

Meta

Type:

Chat

Variant:

Instruct

Parameters:

70B

Deployment:

✔ Serverless

✔ On-Demand Dedicated

✔ Monthly Reserved

Quantization

FP8

Context length:

8K

Pricing:

$0.88

Check pricing

Run in playground

Deploy model

Deploy model

Quickstart docs

Quickstart docs

Serverless

On-Demand Dedicated

Monthly Reserved

Looking for production scale? Deploy on a dedicated endpoint

Deploy Llama 3 70B Instruct Turbo on a dedicated endpoint with custom hardware configuration, as many instances as you need, and auto-scaling.

Get started
Get started

Subscribe to newsletter

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.