Dreams That Last — the RSSM on a Real Robot
Why the MiniPong dream collapsed — and how one state with two halves (a memory that is never sampled, a doubt that always is) lets a world model dream sixty steps of a real SO-101 robot arm with the camera off.
intermediate~2 hours1 notebooksThe Dream That Fell ApartA Real Robot, One Row at a TimeDesign A: A Memory That Cannot ChooseDesign B: Dice That Cannot RememberThe RSSM: One State, Two HalvesTraining Without LabelsThe Verdict: Three Designs, Sixty StepsWhat We Did Not See — and What Comes Next
Curator of this Module
Dr. Rajat Dandekar
Course Instructor
Dr. Rajat Dandekar is a researcher and educator specializing in AI/ML. He teaches the Build a World Model from Scratch series on the Vizuara YouTube channel.
Checking access…
Learning Path
Article
1
Notebook 1Certificate