---
title: "MOEReview Tan: Scattered MoE"
source: https://www.jemoka.com/posts/kbhmoereview_tan_scattered/
---

A single kernel to scatter the residuals and then run forward pass at the same time instead of copying and grouping first.
