Posts tagged #geometry
-
Classifying the RoPE Commutant: Symmetry in Verified Neural Compilation
The algebra of which orthogonal transformations survive RoPE at zero cost, derived from the Symmetry.lean formalization.
-
Stable Rank as an Overfitting Signature in LoRA Fine-Tuning
Why we picked stable rank to detect overfitting geometry in DPO vs CLM fine-tuning, how it connects to "alignment geometry," and what the BitFit baseline was there to check.