Research

• 2026-09-07 Transformer Basics

  The four parts of a transformer — embedding, attention, MLPs, and unembedding — worked through with GPT-3's numbers, accounting for all 175 billion parameters.

• 2026-08-03 Tensor-Product Presentation of NTT and Constant-Geometry NTT

  Tensor product is a good and powerful way to describe and analyze NTTs. This note gives the basics on using tensor product to present NTT and derive the famous constant-geometry using this presentation.

→ More research

Reading

Coming soon.

Field Notes

Coming soon.