Open-source contributions开源贡献
vLLM
Explore the work按问题翻阅
Articles & investigations文章与研究记录
Choose a subject below. Original repository documents and working outlines are marked separately.按实验、排障或设计查找。原始仓库文档与研究提纲会分别标明。
We Removed a CUDA Graph Fallback. It Got Slower.我们移除了 CUDA Graph 回退路径，结果反而变慢了
A working analysis of CUDA Graph coverage, irregular mixture-of-experts workloads, and the cost hidden behind a seemingly simpler execution path.一份关于 CUDA Graph 覆盖率、不规则混合专家负载，以及看似更简单的执行路径所隐藏成本的工作分析。
Communication Overlap Is Not Free通信重叠并非免费
A closer look at GPU contention, NCCL, and the limits of overlap in expert-parallel inference.重新审视专家并行推理中的 GPU 争用、NCCL，以及通信重叠的边界。
Understanding Irregular MoE Execution on Modern GPUs理解现代 GPU 上的不规则 MoE 执行
Analyzing routing, token distribution, and execution behavior without reducing irregular workloads to an average case.分析路由、Token 分布与执行行为，而不把不规则负载简化成平均情形。
GPU Memory Behavior in Long-Context Inference长上下文推理中的 GPU 内存行为
Questions and instrumentation for understanding memory access patterns and bandwidth utilization in long-context serving.用于理解长上下文服务中内存访问模式与带宽利用率的问题和测量方法。
Lessons from LLM Serving Systems大语言模型服务系统经验
A concise index of systems questions to carry from one serving runtime to the next.一份可从一个服务运行时带到另一个运行时的系统问题简明索引。
No matching articles. Try another category or a shorter search.没有匹配文章，可以切换分类或缩短关键词。
0 repository documents份仓库文档 · 5 working outlines篇研究提纲