Models / DeepSeek-V3-0324

DeepSeek-V3-0324

Mixture-of-Experts model challenging top AI models at much lower cost. Updated on March 24th, 2025.

  • Pay-as-you-go — no credit card to start

  • Drop-in OpenAI-compatible API

  • Match closed model quality at 80% lower cost

  • Drop-in OpenAI-compatible API

  • Match closed model quality at 80% lower cost

  • Served in the EU: your data stays in-region

Trusted by

Why DeepSeek-V3-0324 on Together AI

We build for production workloads — not just demos

Leading price performance

Full-stack optimizations deliver higher throughput and lower latency than the leading open source implementations on identical hardware.

Run it your way

Serverless scales to your traffic with per token pricing. Dedicated gives you isolated GPUs tuned to your workload.

Backed by research
that ships

Inference performance is driven by continuous optimization across kernels, scheduling, and runtime systems.

DeepSeek-V3-0324

Endpoint:

deepseek-ai/DeepSeek-V3

About

DeepSeek-V3-0324 is a strong Mixture-of-Experts language model with 671B parameters, 37B activated per token, designed for efficient inference and cost-effective training. It excels in performance, outpacing other open-source models and rivaling leading closed-source models. Suitable for applications requiring high-quality language understanding and generation.

This endpoint was updated on March 24th, 2025 to use the weights of the improved DeepSeek-V3-0324 model.

Pricing

  • Input
    $1.25
    / 1M tokens
  • output
    $1.25
    / 1M tokens

Performance benchmark

DeepSeek-V3-0324 vs competitor closed-source models
GPQA diamond rating
35.3%
DeepSeek-V3-0324
94.1%
GPT-5.6 Sol
93.2%
Claude Opus 5
93.1%
Grok 4.5
92.6%
Claude Fable 5
91.1%
GPT-5.6 Luna
  • Deployment
    Dedicated
  • Main use cases
    Chat
    Function Calling
  • Features
    Function Calling
    JSON Mode
  • Parameters
    671B
  • Context length
    131K
  • Input modalities
    Text
  • Output modalities
    Text

Deployment options

Run models using different deployment options depending on latency needs, traffic patterns, and infrastructure control.

  • Serverless Inference

  • Provisioned 
Throughput

  • Dedicated Model 
Inference

  • Dedicated Container 
Inference

Serverless Inference

A fully managed real-time or batch inference API with access to dozens of the most popular AI models.

2.75x faster

Best for

Variable or unpredictable traffic

Rapid prototyping and iteration

Cost-sensitive or early-stage production workloads

Provisioned 
Throughput

Reserved token capacity with SLA guarantees. Priced in PTUs, a normalized throughput unit.

up to 90% lower cost

Best for

Production workloads

Reliability guarantees

Predictable pricing

Dedicated Model
Inference

An inference endpoint backed by reserved, isolated compute resources and Together AI inference research.

3.18x faster with ATLAS

Best for

Predictable or steady traffic

Latency-sensitive applications

High-throughput production workloads

Dedicated Container
Inference

Run inference with your own engine and model on fully-managed, scalable infrastructure.

100B+ params · 2–3x savings

Best for

Generative media models

Non-standard runtimes

Custom inference pipelines

Customers running inference in production

Young man with black hair wearing a dark jacket and sunglasses standing near a waterfall.
  • cost reduction

  • <400ms

    p95 model latency

  • Weekly

    model deployments

"Low latency is especially important for voice because there’s a much higher UX bar. Together helped us push latency down by optimizing our models with techniques like speculative decoding, and they’ve been a reliable production partner — proactive about risks and fast when issues come up."

Max Lu

Head of Research, Decagon

Smiling young man with light brown hair wearing a blue patterned shirt in a softly blurred indoor setting.
  • ~30%

    Cost savings

"Together has helped us deploy VyUI, our state-of-the-art computer AI model. We had multiple in-depth meetings where we brainstormed how we could satisfy our model's custom technical requirements while still leveraging Together's infrastructure for efficient, load-balanced inference."

Luca Weihs

Co-founder, Vercept

Smiling man with short dark hair wearing a black shirt and dark gray blazer against a light background.

"Together AI offers optimized performance at scale, and at a lower cost than closed-source providers – all while maintaining strict privacy standards."

Vineet Khosla

CTO, The Washington Post

Production-grade
security and data privacy

We take security and compliance seriously, with strict data privacy controls to keep your information protected. Your data and models remain fully under your ownership, safeguarded by robust security measures.

Learn More

We take security and compliance seriously, with strict data privacy controls to keep your information protected. Your data and models remain fully under your ownership, safeguarded by robust security measures.

  • NVIDIA logo with text Preferred Partner on a black background.
    preferred partner
  • SOC 2 Type II
  • ISO 27001:2022