This website uses cookies to anonymously analyze website traffic using Google Analytics.
AcceptDecline

Models / Chat / Llama 3 8B Instruct Reference API

Llama 3 8B Instruct Reference API

LLM

Auto-regressive LLM with optimized transformers, SFT, and RLHF for alignment with helpfulness and safety preferences.

Try our Llama 3 API
API Usage
How to use Llama 3 8B Instruct ReferenceModel CardPrompting Llama 3 8B Instruct ReferenceApplications & Use CasesHow to use Llama 3 8B Instruct Reference

Llama 3 8B Instruct Reference API Usage

Endpoint

meta-llama/Llama-3-8b-chat-hf
Curl
Python
Typescript

RUN INFERENCE

JSON RESPONSE

RUN INFERENCE

JSON RESPONSE

RUN INFERENCE

JSON RESPONSE

Model Provider:

Meta

Type:

Chat

Variant:

Parameters:

8B

Deployment:

✔ Serverless

✔️ On-Demand Dedicated

Quantization

FP16

Context length:

8K

Pricing:

$0.20

Check pricing

Run in playground

Deploy model

Deploy model

Quickstart docs

Quickstart docs

How to use Llama 3 8B Instruct Reference

Model details

Prompting Llama 3 8B Instruct Reference

Applications & Use Cases

How to use Llama 3 8B Instruct Reference

Looking for production scale? Deploy on a dedicated endpoint

Deploy Llama 3 8B Instruct Reference on a dedicated endpoint with custom hardware configuration, as many instances as you need, and auto-scaling.

Get started
Get started

Subscribe to newsletter

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.