This website uses cookies to anonymously analyze website traffic using Google Analytics.

together.pricing

Inference pricing

Over 100 leading open-source Chat, Language, Image and Code models are available through the Together Inference API. For these models you pay just for what you use.

Serverless Endpoints

Prices are per 1,000 tokens including input and output tokens for Chat, Language and Code models, and based on image size and steps for Image models. Special promotional pricing for Llama-2 and CodeLlama models.


  • CHat, language, and code models

    • Model size

      price 1k tokens

    • Up to 4B

      price 1k tokens

      $0.0001

    • 4.1B - 8B

      price 1k tokens

      $0.0002

    • 8.1B - 21B

      price 1k tokens

      $0.0003

    • 21.1B - 41B

      price 1k tokens

      $0.0008

    • 41B - 70B

      price 1k tokens

      $0.0009

  • LLama-2 and codellama Models

    • Model size

      price 1k tokens

    • 7B

      price 1k tokens

      $0.0002

    • 13B

      price 1k tokens

      $0.000225

    • 70B

      price 1k tokens

      $0.0009

  • Image models

    • Image Size

      25 steps

      50 steps

      75 steps

      100 steps

    • 512X512

      25 steps

      $0.001

      25 steps

      $0.002

      75 steps

      $0.0035

      100 steps

      $0.005

    • 1024X1024

      25 steps

      $0.01

      25 steps

      $0.02

      75 steps

      $0.035

      100 steps

      $0.05

Dedicated instances

When hosting your own model you pay hourly for the GPU instances, whether it is a model you fine-tuned using Together Fine-tuning or any other model you choose to host. You can start or stop your instance any time through the web-based Playground or using the start/stop instance APIs.

  • Your fine-tuned models

    • hardware type

      price per hour hosting

      model size

    • Fractional L40 48GB

      price per hour hosting

      $0.70

      price per hour hosting

      Up to 4B

    • 1x L40 48GB

      price per hour hosting

      $1.40

      price per hour hosting

      4.1B - 21b

    • 2x L40 48GB

      price per hour hosting

      $2.80

      price per hour hosting

      21.1B - 41B

    • 2x A100 80GB

      price per hour hosting

      $6.17

      price per hour hosting

      41.1B - 70B

Interested in a dedicated instance for your own model?

Fine-tuning pricing

Pricing for fine-tuning is based on model size, dataset size, and the number of epochs.

  • Download checkpoints and final model weights.

  • View job status and logs through CLI or Playgrounds.

  • Deploy a model instantly once it’s fine-tuned.

Try the interactive calculator

Together GPU Clusters Pricing

Together Compute provides private, state of the art clusters with H100 and A100 GPUs, connected over fast 200 Gbps non-blocking Ethernet or up to 3.2 Tbps InfiniBand networks.

  • haRDWARE TYPES AVAILABLE

    NETWORKING

  • A100 PCIe 80GB

    price 1k tokens

    200 Gbps non-blocking Ethernet

  • A100 SXM 80GB

    price 1k tokens

    200 Gbps non-blocking Ethernet or 1.6 Tbps Infiniband configs available

  • H100 80GB

    price 1k tokens

    3.2 Tbps Infiniband