Introducing Together AI's new look →

For founders and builders defining the AI-native era. Register now →

🔎 ATLAS: runtime-learning accelerators delivering up to 4x faster LLM inference →

⚡ Together Instant Clusters: self-service NVIDIA GPUs, now generally available →

📦 Batch Inference API: Process billions of tokens at 50% lower cost for most models →

🪛 Fine-Tuning Platform Upgrades: Larger Models, Longer Contexts →

Explore Research

Research blog

All
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Inference
RedPajama-Data-v2: An open dataset with 30 trillion tokens for training large language models

Together

Kernels
Flash-Decoding for long-context inference

Tri Dao, Daniel Haziza, Francisco Massa, Grigory Sizov

Inference
Medusa: Simple framework for accelerating LLM generation with multiple decoding heads

Tianle Cai*, Yuhong Li*, Zhengyang Geng, Hongwu Peng, Tri Dao (* Equal contribution)

Finetuning
Llama-2-7B-32K-Instruct — and fine-tuning for Llama-2 models with Together API

Together

No search results

Try expanding your search or changing the filters.