Tag: NCCL

2 articles

• LLM Distributed Inference Communication Fault Debugging: Locating Collective Communication Hangs with NCCL RAS, Flight Recorder, and Topology Baselines

  When NCCL collective communication hangs in large-scale distributed LLM inference, you're often left with only a vague timeout log. This article explains how to use RAS, Flight Recorder, topology baselines, and anomalous rank detection to build observable, rollback-capable communication gating for production deployments.

  07/13/2026 LLM Serving / NCCL / Distributed Inference / GPU / Reliability

• LLM Tensor Parallel Inference Deployment: Reducing Cross-GPU Jitter with Parallelism, NCCL, and Topology Awareness

  A practical guide to Tensor Parallel, Pipeline Parallel, NCCL communication, and topology-aware tuning for large model cross-GPU inference deployment. Covers parallelism selection, node networking, stress testing metrics, and pre-launch checks to help teams reduce multi-GPU service jitter.

  07/07/2026 LLM Serving / Tensor Parallel / NCCL / GPU Inference