Purlin: Separating Orchestration from the Datapath of Collectives
Distributed inference depends on GPU collective communication that must keep pace with evolving hardware and specialized workloads. However, existing collective implementations often couple semantics, orchestration (where and when data moves), and the datapath (how data moves). This coupling makes it costly to adopt new hardware mechanisms and customize communication for applications. We present…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
