NVIDIA HGX B300
NVIDIA Blackwell Ultra platform on Together AI
Why HGX B300 on Together GPU Clusters?
The world’s most powerful AI infrastructure. Delivered faster. Tuned smarter.
Built for AI reasoning on 8-GPU HGX nodes
Each HGX B300 system packs 8 Blackwell Ultra GPUs with a supercharged attention engine and FP4 acceleration for test-time scaling and long-context inference.
Optimized NVLink topologies
1,800 GB/s NVLink per GPU via 5th-gen NVSwitch fabric, extending to spine-leaf or Clos topologies for dense LLMs and sparsely activated MoE workloads.
Delivery without the NVIDIA lottery
Full-rack clusters ship with capacity available; no backorder delays.
Run by researchers who train models
Team actively tunes training workloads on NVIDIA Blackwell systems.
What our customers are saying
"Delivering competitive pricing, strong reliability and a properly set up cluster is the bulk of the value differentiation for most AI clouds. The only differentiated value we have seen outside this set is from a Neocloud called Together AI, where the inventor of FlashAttention, Tri Dao, works. We don't believe the value created by Together can be replicated elsewhere."
"Together GPU Clusters provided a combination of amazing training performance, expert support, and the ability to scale to meet our rapid growth to help us serve our growing community of AI creators."
Demi Guo
CEO, Pika
“Together AI provides the performance and reliability we need for real-time, high-quality image and video generation at scale. We value that Together AI is much more than an infrastructure provider — they're a true innovation partner, enabling us to push creative boundaries without compromise.”
Victor Perez
Co-Founder, Krea
Outstanding specs of HGX B300
2.6x
vs H100
30x
vs H100
7x
vs H100
"We’ve been thoroughly impressed with the Together Enterprise Platform. It has delivered a 2x reduction in latency (time to first token) and cut our costs by approximately a third. These improvements allow us to launch AI-powered features and deliver lightning-fast experiences faster than ever before."
Caiming Xiong
VP Salesforce AI Research
Technical specification
- Blackwell Ultra GPUs 8 GPUs
- Total FP4 Tensor Core 144 PFLOPS
- Total FP8/FP6 Tensor Core 72 PFLOPS
- Total Fast Memory 2.1 TB
- Total Memory Bandwidth 62 TB/s
- Total NVLink Bandwidth 14.4 TB/s
- FP4 Tensor Core (per GPU) 18 PFLOPS
- FP8/FP6 Tensor Core (per GPU) 9 PFLOPS
- INT8 Tensor Core 307 TOPS
- FP16/BF16 Tensor Core 4.5 PFLOPS
- TF32 Tensor Core 2.2 PFLOPS
- FP32 75 TFLOPS
- FP64 / FP64 Tensor Core 1.2 TFLOPS
- Multi-Instance GPU (MIG) 7
- Decompression Engine Yes
- Decoders 7 NVDEC, 7 nvJPEG
- Max Thermal Design Power (TDP) Configurable up to 1,100 W
- Interconnect 5th Gen NVLink: 1.8 TB/s, PCIe Gen6: 256 GB/s
Infrastructure you can trust at scale.
Production-grade security.
We take security and compliance seriously, with strict data privacy controls to keep your information protected. Your data and models remain fully under your ownership, safeguarded by robust security measures.
preferred partner
SOC 2 Type II
ISO 27001:2022
Regions and availability zones
Choose from global regions to meet data residency and compliance requirements—HIPAA for healthcare, GDPR for Europe, or banking regulations.
USA2GW+ in the portfolio with 600MW of near-term capacity in US.
Europe150 MW+ available in Europe: UK, Spain, France, Portugal, and Iceland also.
Asia & Middle EastOptions available based on the scale of the projects in Asia and the Middle East.