Posts tagged #architecture
-
The Impossibility of Key-Only Routing: An Architectural Boundary
Formalizing why MoE routers must depend on residual-stream state rather than key-only summaries.
The Impossibility of Key-Only Routing: An Architectural Boundary
Formalizing why MoE routers must depend on residual-stream state rather than key-only summaries.