ThunderAgent: 2x Faster Agentic Inference for Synthetic Data Generation at Scale
A program-level scheduler that eliminates KV cache thrashing, delivering more than 2x single-node throughput and near-linear multi-node scaling for large-scale agentic inference.