#math

2 articles tagged #math, across Research.

• 2026-09-07 Research Transformer Basics

  The four parts of a transformer — embedding, attention, MLPs, and unembedding — worked through with GPT-3's numbers, accounting for all 175 billion parameters.

• 2026-08-03 Research Tensor-Product Presentation of NTT and Constant-Geometry NTT

  Tensor product is a good and powerful way to describe and analyze NTTs. This note gives the basics on using tensor product to present NTT and derive the famous constant-geometry using this presentation.