All projects全部项目

Personal project自己的项目

MoEFlow

1 GitHub

The question这个项目在研究什么

Expert parallelism, routing & kernels专家并行、路由与内核

Routed MoE execution, CUDA Graph compatibility and the boundary between layer gains and serving performance.路由 MoE 执行、CUDA Graph 兼容性,以及层级收益与端到端服务性能之间的边界。

New to the topic? Start with a small example. Already familiar? Go straight to the articles.第一次接触,先跑一个小例子;已有基础,直接进入文章。

02Starting points入门起点 →
06Articles & investigations文章与研究记录 →
↗Code & original materials代码与原始材料 →
Scope & current evidence研究边界与当前证据Read before applying a result应用结论前请留意

Layer-level and full-model evidence are tracked separately. Stable serving speedup remains an open question in the repository reports.层级实验与完整模型证据分别记录。仓库报告中,服务层面的稳定加速仍是开放问题。

Experimental implementation and research notebook实验实现与研究档案 · 2 working outlines篇研究提纲