Learn LLMs

Building Blocks of GPT-2 LLM

  • Introduction - Building Blocks of GPT-2 LLM
  • Introduction to Large Language Models (LLMs)
  • GPT - Generative Pretrained Transformer model
  • Introduction to tokenization
  • Introduction to embedding
  • Transformer blocks
  • Self-attention mechanism
  • Masked Attention
  • Multi-head self-attention
  • Feedforward neural network (FNN)
  • Language Modeling Head (LM Head)
  • Pre-trained GPT-2 model end to end
  • Dataflow across LLM
  • Reference
    • Book “Build a Large Language Model (From Scratch)”, Sebastian Raschka
    • Hands-On Large Language Models, Jay Alammar, Maarten Grootendorst

Architecting Autonomous Systems

  • Introduction - Architecting Autonomous Systems
  • Anatomy and Taxonomy of Agents
  • AI Agent Interoperability and MCP
  • Context Engineering for Stateful AI Agents
  • Case-study part 1: Explore Anatomy and Taxonomy of Agents
  • Case-study part 2: Explore basics of context engineering
  • Engineering Trust
  • Reference
Learn LLMs
  • Reference
  • Edit on GitHub

Reference

Book “Build a Large Language Model (From Scratch)”, Sebastian Raschka

Build a Large Language Model (From Scratch)

Hands-On Large Language Models, Jay Alammar, Maarten Grootendorst

Hands-On Large Language Models

Previous Next

© Copyright Pubudu Samarakoon, 2026.

Built with Sphinx using a theme provided by Read the Docs.