The Unscalable

The Unscalable

Home
AI/ML Tutorials
Human & Tech
LLM & "AGI"
Archive
About

ai-ml-tutorial

The Beauty of Reinforcement Learning (4) - World Model & Planning
How the concept of world model and planning brings new approaches to reinforcement learning, illustrated through AlphaGo & Dreamer agent.
 • 
Forest
The Beauty of Reinforcement Learning (3) - PPO Demystified
Including analogies that give you a vivid idea of how PPO works, and all the maths that you need to know PPO and its history thoroughly, end to end.
 • 
Forest
The Beauty of Reinforcement Learning (2) - Reinforce with Baseline, A2C & GAE
Reducing the variance of policy gradient algorithms, from REINFORCE with baseline to A2C, to GAE that gracefully unifies them all.
 • 
Forest
The Beauty of Reinforcement Learning (1) - Intro of Policy Based Methods
Reinforcement learning is powerful, beautiful and approachable - an intuitive yet in-depth introduction to reinforcement learning, including the what…
 • 
Forest
Four Simple but Profound Lessons I Learned about ML and AI
The first two lessons are historically influential thesis that have shaped today’s AI/ML research and industry, while the last two lessons tell the flip…
 • 
Forest
From Solomonoff Induction to the Relationship between World, Human and Machine (Part 2)
A thorough illustration of the beauty of Solomonoff induction, its optimality, the reason why such an optimal prediction machine can’t be built to…
 • 
Forest
From Solomonoff Induction to the Relationship between World, Human and Machine (Part 1)
In a series of posts, I will introduce Solomonoff's theory of inductive inference, which is an idealized model for universal prediction and deep dive…
 • 
Forest
© 2025 The Unscalable
Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture