Welcome to rank decomposition.
Notes on machine learning & mathematics.
Exploring RL, quantization techniques & formats, faster inference, benchmarks & evals.
read recently
The Second Half – Shunyu Yao – 姚顺雨
Model Merging — a biased overview | Donato Crisostomi
What’s the deal with mid-training? | Vintage Data
The Mathematician In The Asylum - Providentia
How Does A Blind Model See The Earth? - by henry
Automotive GPU maxxxing | Léo’s Blog
In the Limit, Only Culture Remains | Giulio Starace
Can tinygrad win? | the singularity is nearer
AGI and the RL lottery
reading list
H-Net - Inference · main
’the void’ by nostalgebraist — LessWrong
Hardware Archives — Tim Dettmers
favorites
Georgi Gerganov
Tim Dettmers
Andrej Karpathy