Posts tagged #moe

• Dense Activation-Fit Recovery: Healing Quantized Layers

  May 16, 2026

  How to recover dense performance from quantized layers using activation-fit artifacts and the recovery scripts in lean-mining.

  #research #quantization #moe #deep-learning

• The Impossibility of Key-Only Routing: An Architectural Boundary

  May 10, 2026

  Formalizing why MoE routers must depend on residual-stream state rather than key-only summaries.

  #research #moe #architecture #lean

• The β-lift and FFN Transfer: MoE Compression Part E

  Apr 29, 2026

  Why β transfer in FFNs matters for quantization and the formal 'structure bonus' theorems in MoE compression.

  #research #moe #quantization #lean