Two leaders. One platform.

Together AI and NVIDIA combine Together AI’s fastest, research-optimized AI platform with the industry’s most powerful GPU infrastructure purpose built for AI-native companies — from first token to production scale.

The AI Native Cloud, built on the 
world’s best AI infrastructure

The most advanced AI workloads demand more than raw compute. Together AI layers inference optimization, developer experience, and enterprise trust directly onto NVIDIA's silicon, so your team ships faster without managing infrastructure.

Together AI

Purpose-built for AI-native companies that need reliability, speed, and control at every stage of the model lifecycle.

Best for

Optimized inference with FlashAttention, speculative decoding & continuous batching

Full model lifecycle: pre-training → fine-tuning → production inference

SOC II Type 2 certified, Zero Data Retention policy

Dedicated clusters and private deployments for regulated industries

OpenAI-compatible APIs to migrate in minutes

NVIDIA

From H100 to Blackwell, NVIDIA sets the benchmark for AI training and inference throughput, memory bandwidth, and efficiency.

Best for

H100 / H200 / B200 / GB200 / GB300  availability

NVLink & InfiniBand fabric for multi-node training at scale

TensorRT-LLM inference engine for maximum GPU utilization

Optimizations on Dynamo and CUDA ecosystem

NVIDIA AI Enterprise software support

"Together AI is one of the most important partners in making NVIDIA's AI platform accessible to AI natives at scale. Their work on inference optimization — combined with NVIDIA Dynamo and the latest Hopper and Blackwell silicon — sets a new standard for what production AI infrastructure can look like."

Ian Buck

Vice President, Hyperscale and HPC — NVIDIA

Everything your AI team needs to move faster

Together AI's cloud platform is optimized from the ground up to extract maximum performance from NVIDIA hardware, so you get better throughput, lower latency, and lower cost per token.

H100
Hardware
NVIDIA HGX H100 SXM (80GB)
On-demand
$5.49/hr per GPU
Reserved
Starting at $3.99/hr per GPU
Scale
8 to 256 GPUs
I am interested
H200
Hardware
NVIDIA HGX H200 (141GB)
On-demand
$6.79/hr per GPU
Reserved
Starting at $4.55/hr per GPU
Scale
256 to 1,000 GPUs
I am interested
B200
Hardware
NVIDIA HGX B200
On-demand
$9.95/hr per GPU
Reserved
Starting at $9.09/hr per GPU
Scale
256 to 1,000 GPUs
I am interested
GB200
Hardware
NVIDIA GB200 NVL72
On-demand
Contact us for pricing
Reserved
Contact us for pricing
Scale
512 to 1,000+ GPUs
I am interested

High-performance inference

Together Inference runs on latest-gen NVIDIA GPUs with custom kernels, adaptive speculative decoding, and intelligent quantization to deliver industry-leading tokens/sec at scale.

Private & dedicated deployments

Run models on dedicated NVIDIA GPU clusters in Together's global data centers. Zero Data Retention policy and SOC II compliance for privacy-sensitive production workloads.

200+ models, one API

Access the broadest catalog of open models — DeepSeek, Kimi, MiniMax, Qwen, GLM, Gemma, GPT OSS, and more — all running on NVIDIA infrastructure via a single OpenAI-compatible endpoint.

Built for every AI workload.

    • Production-grade inference at any scale

      Inference

      Serve 10T+ tokens per day with sub-100ms TTFT. Using our cutting-edge research paired with NVIDIA Dynamo, Together's inference engine delivers maximum throughput, so your cost per query drops as volume grows.

    • Train foundation models on dedicated clusters

      Pre-training

      Access NVIDIA's frontier model families — Nemotron for reasoning and agentic AI applications, Parakeet for state-of-the-art speech recognition — all optimized and served via Together’s inference API.

    • Built for what you are building

      Model Shaping

      Fine-tune your models to your domain. Domain-specific fine-tuning, RLHF, and DPO on NVIDIA GPUs. From LoRA adapters to full model updates — your weights, your deployment.

Production ready from day one

Privacy-sensitive U.S. organizations and global enterprises choose Together AI because security and compliance aren’t afterthoughts, they’re built into every layer of the stack.

  • SOC II Type 2 compliant

    Independently audited security controls covering availability, confidentiality, and processing integrity.

  • Zero Data Retention

    Prompts and completions are never stored, logged, or used for training. Your data stays yours.

  • Dedicated infrastructure

    Isolated NVIDIA GPU clusters for customers who need multi-tenancy, network isolation, and custom SLAs.

  • Global data centers

    Multi-region deployments across North America, Europe, and Asia with data residency and zero-trust controls.

Customer stories

Young man with black hair wearing a dark jacket and sunglasses standing near a waterfall.
  • cost reduction

  • <400ms

    p95 model latency

  • Weekly

    model deployments

"Low latency is especially important for voice because there’s a much higher UX bar. Together helped us push latency down by optimizing our models with techniques like speculative decoding, and they’ve been a reliable production partner — proactive about risks and fast when issues come up."

Max Lu

Head of Research, Decagon