CS336 Lecture 1 - Tokenization
·495 words·3 mins
Stanford CS336
Disclaimer: Some of the content and code snippets in these notes are derived from the Stanford CS336 course materials, especially lectures and spring2025-lectures, and are used in accordance with the MIT License.
CS336 Lecture 2 - 1. Memory Accounting
·441 words·3 mins
CS336 Lecture 2 - 2. Compute Accounting
·1565 words·8 mins
CS336 Lecture 2 - 3. Full Example
·1144 words·6 mins
CS336 Lecture 2 - 4. More Memory Optimizations
·451 words·3 mins
CS336 Lecture 3 - Architectures and Hyperparameters
·3110 words·15 mins
CS336 Lecture 4 - Attention Alternatives and Mixture of Experts
·3515 words·17 mins
CS336 Lecture 5 - GPUs
·2692 words·13 mins