Build Qwen3.5 from Scratch
Hybrid attention, Mixture-of-Experts, and local deployment — build the architecture that lets a 9B model outperform one 13x its size.
advanced~5 hours5 notebooksqwen3.5linear-attentiongated-deltanetmixture-of-expertshybrid-attentionlocal-deployment
Curator of this Module
Dr. Rajat Dandekar
Course Instructor
Dr. Rajat Dandekar is a researcher and educator specializing in AI/ML, with a passion for making complex concepts accessible through intuitive explanations and hands-on learning.
Checking access…
Learning Path
Article
1
Notebook 12
Notebook 23
Notebook 34
Notebook 45
Notebook 5Case Study
Certificate