Noah GolmantPersonal site and bloghttps://noahgolmant.com/The local shape of LLM stable regionshttps://noahgolmant.com/blog/stable-regions-residual-stream/https://noahgolmant.com/blog/stable-regions-residual-stream/Most of the time at inference, the Fisher pullback through the unembedding tells you exactly how far you can perturb the residual stream before the predictive distribution moves — and it's literally the second-order Taylor expansion of KL.Mon, 18 May 2026 00:00:00 GMTRevisiting pytorch-hessian-eigenthings, eight years laterhttps://noahgolmant.com/blog/hessian-eigenthings-v1/https://noahgolmant.com/blog/hessian-eigenthings-v1/A v1.0 rewrite of my old curvature analysis library: new operators, new algorithms, and a lot of numerical validation I should have written the first time.Thu, 14 May 2026 00:00:00 GMTDynamical systems and an abstract view of autoregressive transformershttps://noahgolmant.com/blog/diving-into-attention/https://noahgolmant.com/blog/diving-into-attention/Understanding how attention can express logical propositions about correlations between tokens and other fun tips and tricksTue, 08 Dec 2020 00:00:00 GMTAutoregressive transformers and lessons from enactivismhttps://noahgolmant.com/blog/attention-please-intro/https://noahgolmant.com/blog/attention-please-intro/Understanding how attention can express logical propositions about correlations between tokens and other fun tips and tricksSun, 06 Dec 2020 00:00:00 GMTFine-tuned noisehttps://noahgolmant.com/blog/sgd-noise/https://noahgolmant.com/blog/sgd-noise/Studying the covariance structure of mini-batch noise in stochastic gradient descentWed, 18 Apr 2018 00:00:00 GMTMeta-learning and optimizationhttps://noahgolmant.com/blog/maml/https://noahgolmant.com/blog/maml/MAML HuntingMon, 19 Feb 2018 00:00:00 GMTFirst-order methods almost always avoid saddle pointshttps://noahgolmant.com/blog/avoiding-saddle-points/https://noahgolmant.com/blog/avoiding-saddle-points/An application of dynamical systems theory to optimizationFri, 17 Nov 2017 00:00:00 GMT