Communication Overlap Is Not Free通信重叠并非免费
A closer look at GPU contention, NCCL, and the limits of overlap in expert-parallel inference.重新审视专家并行推理中的 GPU 争用、NCCL，以及通信重叠的边界。
Working outline研究提纲 · Hypotheses and measurement plans; verified results are still being attached.包含假设与测量计划，经验证的结果仍在补充中。
Working premise
Overlap changes when a cost is paid and which resource observes it. This note is an outline pending verified measurements.
Evidence needed
- An exact software and hardware configuration
- Paired traces with the same inputs
- Device, network, and CPU utilization
- A clear definition of the end-to-end objective
Status
TODO: add validated results and link the corresponding implementation.
工作前提
重叠执行改变的是成本在何时支付，以及由哪一种资源承担。本文仍是一份工作提纲，等待经验证的测量结果。
所需证据
- 精确的软件与硬件配置
- 使用相同输入的成对性能轨迹
- 设备、网络与 CPU 利用率
- 对端到端目标的明确界定
状态
TODO：补充经过验证的结果，并链接对应实现。