AI Tutorials
Factual Recall Mechanisms in Gemma-2B and Gemma-12B-IT
An in-depth analysis of how Gemma models store and retrieve facts using activation patching, detailing a three-phase circuit involving subject recognition, attribute mapping, and logit readout.
Read more →