Writing
Notes & essays
Interpretability research notes, paper notes, and the occasional personal essay.
-
Paper Notes: Mechanistic?
My notes on the "Mechanistic?" paper — the origins of mechanistic interpretability as a term, field, and community.
-
Lazy Ambitious, or Overthinking?
-
Feature Geometry in Toy Models: Pentagon vs Hexagon
Why ReLU toy models cap at pentagon geometry, and what pushes them toward a hexagon.
-
Effects of Non-Uniform Sparsity on Superposition in Toy Models
How non-uniform feature sparsity reshapes superposition in ReLU toy models.
-
The Myth of 'Are You Doing Enough?'
-
Fear or Love?