⚡️ FlashAttention-4: up to 1.3× faster than cuDNN on NVIDIA Blackwell →

Introducing Together AI's new look →

🔎 ATLAS: runtime-learning accelerators delivering up to 4x faster LLM inference →

⚡ Together GPU Clusters: self-service NVIDIA GPUs, now generally available →

📦 Batch Inference API: Process billions of tokens at 50% lower cost for most models →

🪛 Fine-Tuning Platform Upgrades: Larger Models, Longer Contexts →

Models / Meta
LLM
Chat

Llama 3.1 70B

Multilingual LLM pre-trained and instruction-tuned, surpassing open and closed models on key benchmarks.

Try our Llama 3.1 API
read docs

About model

Llama 3.1 70B provides highly accurate and informative responses to user input, excelling at understanding and generating human-like text. Its key strength lies in its ability to follow instructions and engage in productive conversations. It is suitable for developers and businesses requiring advanced language understanding and generation capabilities.

    Related models
    Chat
    Gemma-4-31B-it-Pearl

    • Input/1M

      $0.28

    • Output/1M

      $0.86
    • Parameters
      31B
    Function Calling
    JSON Mode
    Reasoning
    new
    Chat
    GLM-5.1

    • Input/1M

      $1.40

    • Output/1M

      $4.40
    • Parameters
      754B
    Function Calling
    JSON Mode
    Reasoning
    Chat
    New
    Chat
    MiniMax M2.7

    • Cached/1M

      $0.06

    • Input/1M

      $0.30

    • Output/1M

      $1.20
    Function Calling
    JSON Mode
    Prompt Caching
    Reasoning
    Code
    Chat
    Model specifications
    Model data
    • Model provider
      Meta
    • Type
      LLM
      Chat
    • Deployment
      On-Demand Dedicated
      Monthly Reserved
    • Parameters
      70B
    • Context length
      128K
    • Input price

      $0.88 / 1M tokens

    • Output price

      $0.88 / 1M tokens

    • Input modalities
      Text
    • Output modalities
      Text
    • Released
      July 22, 2024
    • Last updated
      February 24, 2026
    • Quantization level
      FP8
    • External link
      Provider docs
    • Category
      Chat
    Quickstart docs
    Deploy model