⚡️ FlashAttention-4: up to 1.3× faster than cuDNN on NVIDIA Blackwell →

Introducing Together AI's new look →

🔎 ATLAS: runtime-learning accelerators delivering up to 4x faster LLM inference →

⚡ Together GPU Clusters: self-service NVIDIA GPUs, now generally available →

📦 Batch Inference API: Process billions of tokens at 50% lower cost for most models →

🪛 Fine-Tuning Platform Upgrades: Larger Models, Longer Contexts →

Explore Research

Research blog

All
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Applications
Multimodal Document RAG with Llama 3.2 Vision and ColQwen2

    Zain Hasan

    Architecture
    The Mamba in the Llama: Distilling and Accelerating Hybrid Models

      Junxiong Wang, Daniele Paliotta, Avner May, Alexander M. Rush, Tri Dao

      Inference
      Speculative decoding for high-throughput long-context inference

        Jian Chen, Vashisth Tiwari, Ranajoy Sadhukhan, Yunho Jin, Zhuoming Chen, Jinyuan Shi, Ian En-Hsu Yen, Avner May, Beidi Chen

        Inference
        TEAL: Training-Free Activation Sparsity in Large Language Models

          James Liu, Pragaash Ponnusamy, Tianle Cai, Han Guo, Yoon Kim, Ben Athiwaratkun

          No search result

          Try expanding your search or changing the filters.