Posts tagged #rope
-
The Pi/8 Instruction Output Audit: Phase 5 Benchmarks
A deep dive into Phase 5 results, SEP scores, and the final paper-ready benchmarks for RoPE-Provenance.
-
Asymmetric Compliance Damage: The Cost of Isolation
Measuring the damage to instruction following vs. data processing when RoPE subspaces are constrained.
-
Counterfactual Provenance Experiments: Stress-Testing Token Roles
Analyzing the Counterfactual V2 results—how the model behaves when provenance signals are zeroed or adversarial.
-
Multi-Head Foldability: Scaling Verified Compilation
Lifting single-head RoPE proofs to multi-head bundles and residual wrappers in the Verified Neural Compilation project.
-
The Pre-W Learnable Role-Angle Mechanism: RoPE-Provenance
Moving beyond fixed π/2 offsets to learnable provenance rotations and the 'pre-W' transport interpretation.
-
Classifying the RoPE Commutant: Symmetry in Verified Neural Compilation
The algebra of which orthogonal transformations survive RoPE at zero cost, derived from the Symmetry.lean formalization.