This website uses cookies to anonymously analyze website traffic using Google Analytics.
Company

DeepSeek-V3.1: Hybrid Thinking Model Now Available on Together AI

August 26, 2025

By 

Together AI

Deploy the hybrid model with both fast response and deep reasoning modes - now production-ready on Together's infrastructure

Starting today on Together AI, you can access DeepSeek-V3.1 — the hybrid model that supports both fast responses and deep reasoning modes through configurable chat templates. Choose non-thinking mode for speed or thinking mode for complex analysis.

TL;DR:

  • DeepSeek-V3.1 API on Together AI: Choose between fast responses and deep reasoning modes in one model
  • Efficiency breakthrough: Comparable quality to DeepSeek-R1 but significantly faster, making deep reasoning practical for production
  • Built-in agent support: Native code and search agent capabilities with specialized tool-calling workflows optimized for production use on Together's optimized infrastructure
  • Available now on Together AI: Serverless APIs with enterprise reliability and fine-tuning capabilities

How the Hybrid Model Works

DeepSeek-V3.1 operates in two modes through configurable chat templates. You can select non-thinking mode for tasks requiring fast responses or thinking mode for problems needing step-by-step analysis.

DeepSeek-V3.1's thinking mode achieves comparable answer quality to DeepSeek-R1 while responding significantly faster, making deep reasoning practical for production applications.

⚡ Non-Thinking Mode
Fast responses for routine tasks
Code completion, simple queries, API calls
🧠 Thinking Mode
Deep reasoning for complex problems
Debugging, analysis, multi-step workflows

The model includes built-in support for code agents and search agents, with specialized formatting optimized for multi-turn tool-calling workflows. You control mode selection through the chat template configuration.

Built on DeepSeek-V3.1-Base through substantial long-context extension training - 630B tokens for 32K context and 209B tokens for 128K context, ensuring robust performance across extended conversations and large codebases.

Real Applications for Hybrid Intelligence

DeepSeek-V3.1's hybrid architecture delivers measurable improvements across established coding and agent tasks:

💻 Code Agents
⚡ Non-thinking: Generate API endpoints, write unit tests, fix syntax errors
🧠 Thinking: Debug distributed system failures, architect microservices decomposition, design database migration strategies with zero-downtime requirements
🔍 Search Agents
⚡ Non-thinking: Basic fact lookup, simple database queries, standard search operations
🧠 Thinking: Multi-step research across enterprise knowledge bases, correlate information from multiple data sources, design complex search workflows with filtering and analysis
📄 Document Processing
⚡ Non-thinking: Extract entities from contracts, classify document types, basic text parsing
🧠 Thinking: Analyze multi-document compliance workflows, cross-reference contract terms with regulatory requirements, synthesize insights from large document collections

The hybrid model allows you to choose the appropriate cognitive mode for your task complexity, eliminating the need to route between different specialized models for these workflows.

Performance Across Both Modes

📊 Benchmark Non-Thinking Thinking Difference
🎯 MMLU-Redux 91.8% 93.7% +1.9%
🔬 GPQA-Diamond 74.9% 80.1% +5.2%
💻 LiveCodeBench 56.4% 74.8% +18.4%
🧮 AIME 2024 66.3% 93.1% +26.8%

The performance differences show where each mode excels. Non-thinking mode handles routine tasks efficiently, while thinking mode provides substantial improvements on complex problems requiring multi-step  reasoning.

Production Deployment on Together AI

The new DeepSeek hybrid model is available both through our DeepSeek-V3.1 serverless API and Dedicated Endpoints.

⚡ Technical Specs
✓ 671B total parameters
✓ 37B active per token
✓ 128K context (extended training)
✓ MIT licensed
🌍 Infrastructure
✓ 99.9% uptime SLA
✓ North American data centers
✓ Serverless scaling
✓ SOC 2 compliant
🛠 Developer Tools
✓ OpenAI-compatible APIs
✓ Fine-tuning available
✓ Batch processing
✓ Custom endpoints

Together AI's optimizations ensure both thinking and non-thinking modes perform reliably under production workloads. Our NVIDIA GPU infrastructure is specifically tuned for large mixture-of-experts models like DeepSeek-V3.1, with transparent pricing that scales with your usage patterns.

Getting Started

DeepSeek-V3.1 on Together AI provides both responsive interaction and deep reasoning capabilities and can be deployed immediately through Together AI's production APIs:

Use our Python SDK to quickly integrate DeepSeek-V3.1 into your applications:

    
      from together import Together

      client = Together()

      response = client.chat.completions.create(
          model="deepseek-ai/DeepSeek-V3.1",
          messages=[],
          stream=True
      )
      for token in response:
          if hasattr(token, 'choices'):
              print(token.choices[0].delta.content, end='', flush=True)
    

Start building today:

  • Lower
    Cost
    20%
  • faster
    training
    4x
  • network
    compression
    117x

Q: Should I use the RedPajama-V2 Dataset out of the box?

RedPajama-V2 is conceptualized as a pool of data that serves as a foundation for creating high quality datasets. The dataset is thus not intended to be used out of the box and, depending on the application, data should be filtered out using the quality signals that accompany the data. With this dataset, we take the view that the optimal filtering of data is dependent on the intended use. Our goal is to provide all the signals and tooling that enables this.

Try DeepSeek V3.1

Contact us to discuss enterprise deployments, custom integrations, or volume pricing for Deepseek V3.1

No items found.
Start
building
yours
here →