A catalog of every MLP neuron and attention head of Qwen3-8B and Gemma 4 12B, read from the weights through two Jacobian lenses (R and S), from activations, and from their exact token drivers
neurons gemma interpretability multimodal attention-heads llm mechanistic-interpretability qwen3 logit-lens s-lens r-lens
-
Updated
Nov 16, 2026 - Python