Lessons from LLM Serving Systems大语言模型服务系统经验
A concise index of systems questions to carry from one serving runtime to the next.一份可从一个服务运行时带到另一个运行时的系统问题简明索引。
Working outline研究提纲 · Hypotheses and measurement plans; verified results are still being attached.包含假设与测量计划,经验证的结果仍在补充中。
Working list
Optimize only after the workload, objective, and evidence are explicit. TODO: expand with verified case studies.
工作清单
只有在负载、目标和证据都明确之后再进行优化。TODO:使用经验证的案例研究扩展本清单。