Noah GolmantPersonal site and bloghttps://noahgolmant.com/Revisiting pytorch-hessian-eigenthings, eight years laterhttps://noahgolmant.com/blog/hessian-eigenthings-v1/https://noahgolmant.com/blog/hessian-eigenthings-v1/A v1.0 rewrite of my old curvature analysis library: new operators, new algorithms, and a lot of numerical validation I should have written the first time.Thu, 14 May 2026 00:00:00 GMTDynamical Systems and a Suitably Abstract View of Autoregressive Transformershttps://noahgolmant.com/blog/diving-into-attention/https://noahgolmant.com/blog/diving-into-attention/Understanding how attention can express logical propositions about correlations between tokens and other fun tips and tricksTue, 08 Dec 2020 00:00:00 GMTAutoregressive Transformers and Lessons From Enactivismhttps://noahgolmant.com/blog/attention-please-intro/https://noahgolmant.com/blog/attention-please-intro/Understanding how attention can express logical propositions about correlations between tokens and other fun tips and tricksSun, 06 Dec 2020 00:00:00 GMTFine-tuned Noisehttps://noahgolmant.com/blog/sgd-noise/https://noahgolmant.com/blog/sgd-noise/Studying the covariance structure of mini-batch noise in stochastic gradient descentWed, 18 Apr 2018 00:00:00 GMTMeta-Learning and Optimizationhttps://noahgolmant.com/blog/maml/https://noahgolmant.com/blog/maml/MAML HuntingMon, 19 Feb 2018 00:00:00 GMTFirst-order Methods Almost Always Avoid Saddle Pointshttps://noahgolmant.com/blog/avoiding-saddle-points/https://noahgolmant.com/blog/avoiding-saddle-points/An application of dynamical systems theory to optimizationFri, 17 Nov 2017 00:00:00 GMT