NVIDIA Demonstrates Eight-Node DGX Spark Clusters
- Eight DGX Spark nodes combine for 1 TB of unified memory, enough to load the full GLM 5.3 753B checkpoint locally.
- In a four-node NVFP4 test, NVIDIA's Spark-focused communication backend improved prefill throughput by about 5% and decode throughput by about 21%.
- A direct ring can suit four-node inference, while scaling to eight nodes or splitting a cluster into groups calls for a switch.
- With Switchyard routing requests between models, aggregate throughput reached about 1.5x or 3x the Qwen-only baseline, depending on the routing split.
- For nanochat pre-training from scratch, eight nodes delivered 7.79x speedup at 97.4% efficiency.
Our take
RoCEnante targets low-concurrency, small-message communication on switched clusters; NCCL remains the default and is better suited to growing cluster sizes or heavier concurrency. Teams should choose the network topology around their workload: a ring keeps a four-node inference setup simpler, while multi-model routing and split allocations require switch connectivity. The source does not establish how these results compare with other local cluster hardware or what the full deployment cost would be.
Sources
- Running Frontier-Class AI Models Across 8 NVIDIA DGX Spark Nodes · NVIDIA Developer
The summary and analysis were generated by AI. The original sources are authoritative. AI content policy