GRPO's Main Flaw
GRPO may not be the best choice for training reasoning models. Here’s why.
(Linear) Attention as Test-Time Regression
A unifying framework for linear attention mechanisms as test-time regression and how to parallelize training and inference.
Deep Learning Optimizers as Steepest Descent in Normed Spaces
Instead of asking, ‘Which optimizer should I use?’ ask, ‘In which space do my features live in?’
ChatGPT May Have Developed Seasonal Depression
Could ChatGPT’s shorter responses be an indication of something more bizarre going on?
The Human Mind May Be Universal
Years of experience in building artificial minds led me to believe that these AIs may end up seeming more ‘human’ than we currently imagine them to be.
Four Rules for Rulers
On how to gain and maintain power.
Vaccine Search as a Computational Problem
A thought dump on mRNA vaccines and the future of computational biology
The Accuracy-Fairness Dilemma in Machine Learning
Machine learning models merely amplify our biases - not eliminate them.
How to Master Machine Learning: 3 Tips to Get Started
Whether you’re only here for the hype or genuinely interested in the field, you’re in for a wild ride.