GPU Memory — The Four Major Components
Understand where your GPU memory actually goes: weights, gradients, optimizer states, and activations — the four components that determine whether your model fits.
beginner~3 hours3 notebooksWeights, Gradients, and Optimizer States: Where Your Memory GoesActivation Memory: The Hidden Memory HogProfiling GPU Memory with PyTorch
Curator of this Module
Dr. Rajat Dandekar
Course Instructor
Dr. Rajat Dandekar is a researcher and educator specializing in AI/ML, with a passion for making complex concepts accessible through intuitive explanations and hands-on learning.
Checking access…
Learning Path
Article
1
Notebook 12
Notebook 23
Notebook 3Certificate