LLMs

A hierarchical index of presentation series for AI / LLM / agentic engineers — from transformer internals and GPU hardware up through retrieval, agents, evaluations, safety and production operations.

Every project that used to be indexed here directly is still reachable — typically through its sub-hub (one click of indirection). The 25 sub-hubs below collectively re-export ~198 leaf repos: ~80 pre-existing presentations, 5 MCP decks, 78 decks across 14 mid-2025 series (now including a two-deck deep-dive companion on the two-step retrieval cascade architecture and the underlying reranker mathematics), the 10-deck LLM History series covering people, labs and ideas from Shannon to the multipolar 2026 frontier, the 12-deck Mathematics for Machine Learning companion to Deisenroth, Faisal & Ong, and the 7-deck Karpathy: Neural Networks Zero to Hero series walking through Andrej Karpathy's from-scratch teaching codebases (micrograd, makemore, minbpe, minGPT, nanoGPT, llm.c, nanochat), and the 10-deck Key LLM Publications series indexing the fifty most important papers, articles and blog posts for a practising LLM/agent engineer — from the Transformer to the Model Context Protocol — each with a summary, an engineer's interpretation, and diagrams, and the 6-deck Transformer Circuits Thread series presenting Anthropic's mechanistic-interpretability research from transformer-circuits.pub (a mathematical framework for transformer circuits, induction heads, superposition, dictionary-learning features, their scaling to Claude 3 Sonnet, and circuit tracing) — plus the directly-linked code repos and articles below.

---

Cloneable code repositories

Most leaves are interactive HTML presentations rendered on GitHub Pages. The repos below are different — they ship runnable source you can clone and execute outside the browser. Listed here for direct discoverability.

Repo	Sub-hub	What's inside
LLM_Transformer_Decoder_RTL	Transformer Architecture	Synthesisable SystemVerilog implementation of a pre-norm decoder block with KV-cache, plus an 83-test verification suite
Python_Transformer_Decoder	Transformer Architecture	Step-by-step PyTorch implementation in a single Jupyter notebook — every component built from first principles
NN_data_types	Transformer Architecture	SystemVerilog implementations of 9 numerical formats (FP32 down to FP4) used in NN training and inference hardware
AI_MMUL_Unit	Transformer Architecture	Hardware deep-dive on the MMUL — 24-slide interactive deck (Kung 1978/82 → TPU → Blackwell, four dataflows, Transformer mapping, FP32→FP4 / MXFP / NVFP4, real systems, memory hierarchy, power & thermals) plus four parameterised SystemVerilog implementations and 258 passing tests
transformer-explainer	Transformer Architecture	Full-stack interactive web app at transformer-explainer-three.vercel.app — type your own tokens and watch every op (embeddings, masked self-attention, FFN, layernorm, sampling) execute server-side. Pure-TypeScript transformer library verified against PyTorch fixtures to 1e-5. Ships with a backend-engineering PDF tour and a Reveal.js presentation walking through Next.js 14, Drizzle, Auth.js, the test pyramid, CI/CD, and the six production bugs we hit going live
Introduction_to_LangGraph	Agents & Orchestration	Interactive slide deck plus 10 runnable examples in Python and TypeScript covering graph-based agent orchestration
ReAct_math_agent	Agents & Orchestration	Browser-based ReAct agent that solves maths problems step-by-step with a local Ollama LLM, visualising the reasoning loop
Research_Digest_Agent	Agents & Orchestration	Autonomous research agent that searches the web, reads sources, and produces structured markdown digests (Claude or Ollama)
Raschka_Coding_Agent_LangGraph	Coding Agents Internals	LangGraph implementation of Sebastian Raschka's Components of a Coding Agent — six components mapped one-per-module (workspace context, cacheable stable-prefix prompt, sandboxed file/shell tools, transcript compression, two-tier memory), swappable Gemini / DeepSeek / OpenAI / fake providers chosen in .env, full-fidelity LLM tracing (rich panels + JSONL on disk), 29 offline tests, written as a learning resource

---

Sub-hub index

Each row points to a sub-hub repo whose README and GitHub Pages site list the leaf decks for that area. The code marker on the Status column flags sub-hubs that include cloneable-code leaves listed above.

Foundations & Internals

Sub-hub	Status	What's inside
Transformer Architecture	live · 8 decks · 5 code	Decoder-only transformer internals — visual walkthrough, every-computation forward pass, RTL accelerator, nanoGPT, PyTorch from scratch, NN data types, hardware-aware quantisation, MMUL hardware deep-dive, and the full-stack interactive web explainer
Karpathy: Neural Networks Zero to Hero	live · 7 decks	Interactive walkthroughs of Andrej Karpathy's from-scratch teaching codebases — micrograd (autograd & backprop), makemore (char-level LMs, BatchNorm, WaveNet), minbpe (the GPT tokeniser), minGPT and nanoGPT (the GPT itself), llm.c (training in raw C/CUDA), and nanochat (a full ChatGPT pipeline). Cross-links the existing nanoGPT deck shared with the Transformer Architecture hub
Qwen	live · 12 decks	The complete Qwen family, generation by generation — Qwen 1.0/1.5 (tokenizer, context tricks, the first MoE), Qwen2/2.5 (GQA, 18T tokens, YaRN & dual chunk attention, Coder/Math/VL/Omni), QwQ & QVQ (RL with verifiable rewards, test-time compute), Qwen3 (hybrid thinking, 128-expert MoE, the 2507 split) with a full Qwen3-Coder deep dive (pros/cons, benchmarks, every flag, vLLM capability matrix), Qwen3-Next (Gated DeltaNet, 3:1 hybrid, MTP), the multimodal & specialist lines (VL, Omni, Embedding/Reranker, Guard, Image, ASR), Qwen3.5 (native multimodal, 201 languages), Qwen3.6→3.8 (dense returns, the 2.4T Max tier) — plus reference decks on serving Qwen with vLLM and on choosing, sizing and deploying
Modern Architectures	live · 10 decks	Architectures beyond the vanilla decoder — Mixture of Experts, Mamba and state-space models, long-context techniques (RoPE / YaRN / ring attention), diffusion language models, hybrids; plus a 5-deck companion to Raschka's Beyond Standard LLMs (linear-attention hybrids, text diffusion, code world models, small recursive transformers, decision tree)
Training & Fine-Tuning	live · 5 decks	SFT pipelines, LoRA / QLoRA / DoRA / IA3, RLHF + PPO, DPO and cousins (IPO / KTO / ORPO / GRPO), Constitutional AI / RLAIF
Reasoning Models	live · 3 decks	The o1 / R1 paradigm shift, scaling test-time compute, process vs outcome reward models, when to use reasoning models vs frontier+scaffolding
Linear Algebra for AI/ML	live · 12 decks	Vectors, matrices, matmul, projections (FFN up/down), eigen, SVD & LoRA, orthogonality & RoPE, gradients & backprop, attention as linear algebra, the full transformer block, tensors / einsum / FlashAttention / MoE / sharding
Mathematics for Machine Learning	live · 12 decks	Twelve-deck companion to Deisenroth, Faisal & Ong's Mathematics for Machine Learning (Cambridge University Press, 2020). Part I — linear algebra, analytic geometry, matrix decompositions, vector calculus, probability, optimisation; Part II — linear regression, PCA, GMM/EM, and the kernel SVM. Lives on the Mathematics hub but re-listed here for AI-engineer discoverability

Hardware & Inference

Sub-hub	Status	What's inside
NVIDIA GPU Architectures	live · 37 decks	Pascal → Blackwell deep tour — SMs, tensor cores, memory hierarchy, NVLink, packaging, power, per-architecture low-level deep dives, the DGX Spark workstation
Google TPUs	live · 12 decks	Twelve-deck deep tour of the TPU programme — 2013 voice-search napkin maths through Ironwood (v7) — history, systolic arrays, every generation v1→v7, OCS & Palomar, ICI & 3D torus, XLA / JAX / Pallas software stack, TPU vs GPU
CUDA Programming	live · 10 decks	From your first kernel to tiled matmul, streams, atomics, Nsight profiling — visual presentations on writing CUDA from scratch
Local LLM Hosting	live · 11 decks	Self-hosting LLMs — Ollama, vLLM, llama.cpp, TGI, SGLang, Docker, multi-GPU parallelism, quantisation, determinism, production patterns
NVIDIA DeepStream	live · 8 decks	The streaming vision-AI SDK end-to-end — the big picture, GStreamer foundations & the NVMM/NvBufSurface memory model, the 40+ plugin toolbox, inference with TensorRT & Triton (nvinfer/nvinferserver), multi-object tracking (IOU/NvSORT/NvDCF/NvDeepSORT + Re-ID + SV3DT), the NvDsBatchMeta graph & nvdsanalytics, edge-to-cloud messaging (nvmsgconv/nvmsgbroker, Kafka/MQTT/IoT, smart record), and building & deploying (deepstream-app, pyds, Graph Composer, NGC/Kubernetes, perf tuning)

Retrieval & Multimodality

Sub-hub	Status	What's inside
RAG & Retrieval Systems	live · 9 decks	Embedding models, vector databases, hybrid search and reranking (plus deep-dive companions on two-step cascade architecture and reranker mathematics — cross-encoder attention, ColBERT MaxSim, RankNet/LambdaRank/LambdaMART, InfoNCE, MarginMSE distillation, NDCG derivations), chunking and ingestion, agentic RAG, GraphRAG, production RAG
Vision-Language Models	live · 5 decks	CLIP / SigLIP, Vision Transformers, modern VLMs (Llama 3.2 V, Qwen2-VL, InternVL, Pixtral, Gemini, Claude), document AI (ColPali, Donut), and Qwen3-VL for video analytics — clip embedding, temporal-aware rerank, M-RoPE, edge-vs-cloud topology
Voice & Real-Time Agents	live · 3 decks	Streaming ASR + TTS, real-time frameworks (Pipecat, LiveKit Agents, OpenAI Realtime), latency budgets and turn-taking

Agents & Tools

Sub-hub	Status	What's inside
Agents & Orchestration	live · 8 decks · 3 code	How LLM agents work, multi-agent coordination, LangGraph, framework guides (LangGraph / CrewAI / AutoGen / OpenAI Agents), a Pydantic AI deep-dive (type-safe agents, structured outputs, DI, durable execution, MCP, Logfire/evals), ReAct math agent, research-digest agent
Coding Agents Internals	live · 7 decks · 1 code	How Cursor, Aider, Claude Code & Codex CLI work — repo understanding, edit strategies, plus a 5-deck companion to Raschka's Components of a Coding Agent (context, cache, tools, memory, subagents) and a runnable LangGraph implementation of the same six components
Computer-Use & Browser Agents	live · 2 decks	Anthropic Computer Use, OpenAI Operator, Gemini Mariner, Browser-Use, Playwright — action schemas, screen vs DOM grounding, evals
Model Context Protocol	live · 5 decks	Anthropic's open protocol for connecting LLMs to tools and data — JSON-RPC primitives, transports, server-building, OAuth 2.1 security, ecosystem and patterns

Production & Safety

Sub-hub	Status	What's inside
Production LLMOps	live · 4 decks	LLM gateways (LiteLLM, Portkey), observability (Langfuse, Phoenix), caching strategies, cost and SLO discipline
LLM Evaluations	live · 5 decks	Static benchmarks vs production evals, LLM-as-judge with its biases, eval frameworks (Inspect AI, Braintrust, Phoenix, Langfuse), drift detection, red-teaming
Safety, Alignment & Red-Teaming	live · 2 decks	Jailbreak taxonomy, defence-in-depth (Llama Guard, ShieldGemma, NeMo Guardrails), regulatory frame (NIST AI RMF, EU AI Act)
LLM-as-a-Service (Cloud *aaS 06)	live · 1 deck	Managed LLM service providers — pricing & latency comparison (OpenAI / Anthropic / Bedrock / Vertex / Azure OpenAI / Together / Groq / Fireworks / Replicate), prompt caching, embeddings & RAG-as-a-Service, agents-as-a-Service, fine-tuning APIs, evals / observability, MCP server hosting, LLM-specific security and governance. Companion to Local LLM Hosting (the self-hosted side) and part of the Cloud *aaS series on the Software index

LLM History

Sub-hub	Status	What's inside
LLM History	live · 10 decks	A history of large language models from Shannon (1948) to the multipolar 2026 frontier — people, labs and ideas. Pre-Transformer NLP, the 2017 transformer paper and its eight authors, university labs, OpenAI, Anthropic, Google DeepMind, Meta/Mistral/xAI/Cohere, the Chinese frontier labs (DeepSeek, Qwen, Kimi, GLM, Yi), and a forecast deck on future directions. Equal attention to technical detail and the human story behind the field

Anthropic Claude

Sub-hub	Status	What's inside
Anthropic Claude	live · 1 deck	Comprehensive presentation series on Claude — models, Claude.ai, Claude Code, API and SDKs, integrations, agents, productivity, Claude Desktop, hands-on workflow walkthroughs

Key Publications

Sub-hub	Status	What's inside
Key LLM Publications	live · 10 decks	Fifty essential papers, articles and blog posts every practising LLM/agent engineer should know — ten themed decks of five, each publication with a plain-language summary, an engineer's interpretation, and diagrams of the core idea. Foundations (Transformer, BERT, GPT-3, scaling laws, Chinchilla); alignment & fine-tuning (InstructGPT/RLHF, Constitutional AI, LoRA/QLoRA, DPO); reasoning & test-time compute (CoT, self-consistency, Tree of Thoughts, process rewards, DeepSeek-R1); efficient inference (FlashAttention, MoE, GPTQ, PagedAttention/vLLM, speculative decoding); context, position & retrieval (RoPE, RAG, DPR, lost-in-the-middle, Self-RAG); agents & tool use (ReAct, Toolformer, Reflexion, Building Effective Agents, MCP); evaluation & benchmarks (MMLU, HumanEval, BIG-bench, HELM, LLM-as-Judge); multimodal models (ViT, CLIP, Flamingo, LLaVA, Whisper); open models & architectures (LLaMA, Llama 2, Mistral, Mixtral, DeepSeek-V3); safety, jailbreaks & security (GCG, prompt injection, Llama Guard, Sleeper Agents, weak-to-strong)

Interpretability

Sub-hub	Status	What's inside
The Transformer Circuits Thread	live · 6 decks	Anthropic's mechanistic-interpretability research from transformer-circuits.pub, presented for engineers as six single-publication deep dives tracing one arc: A Mathematical Framework for Transformer Circuits (residual stream, QK/OV circuits, composition); In-context Learning & Induction Heads (the phase change behind in-context learning); Toy Models of Superposition (why neurons are polysemantic); Towards Monosemanticity (sparse autoencoders / dictionary learning recover interpretable features); Scaling Monosemanticity (features extracted from Claude 3 Sonnet, feature steering, "Golden Gate Claude"); and On the Biology of a Large Language Model (circuit tracing with attribution graphs on Claude 3.5 Haiku). Complements the broad Key LLM Publications canon and the Safety, Alignment & Red-Teaming hub

---

Articles & Reference

Project	Description
LLM Articles	Articles and presentations on batching, KV cache optimisation, and quantisation for inference

---

How this is organised

• The top-level index (this README) lists 25 sub-hubs grouped into five themes plus the LLM History, Anthropic Claude, Key Publications and Interpretability sections, with directly-linked code repos and articles called out separately.
• Each sub-hub repo is a small index of leaf-deck repos in that area. The sub-hub's README.md and its GitHub Pages site (e.g. https://brendanjameslynskey.github.io/LLM_Hub_RAG_Retrieval/) both list the decks.
• Each leaf deck is its own repo (typically Topic_NN_Title) with a single-page interactive HTML presentation served on GitHub Pages.
• Status legend. live · N decks — all leaves built and indexed by the sub-hub. roadmap · N decks — topic outline published, leaf decks landing progressively. · N code — sub-hub includes that many cloneable-source leaves (listed in the Cloneable code repositories table above).