Meta tags:
description= Learn it. Build it. Ship it for others. Contribute to rohitg00/ai-engineering-from-scratch development by creating an account on GitHub.;
Headings (most frequently used words):
the, uh, oh, of, agent, code, navigation, your, this, lesson, every, saved, searches, from, to, files, history, memory, works, shape, contributing, sponsor, license, footer, course, into, search, repositories, users, issues, pull, requests, provide, feedback, rohitg00, ai, engineering, scratch, menu, use, filter, results, more, quickly, folders, and, latest, commit, repository, creator, persistent, which, naturally, with, any, agents, or, chat, assistants, how, curriculum, getting, started, ships, something, contents, toolkit, where, start, why, matters, now, work, star, about, releases, project, packages, contributors, languages, prerequisites, built, in, skills, claude, cursor, codex, openclaw, hermes, fig_002, worked, sample, phase, setup, tooling, 12, lessons, install, skill, drop, workbench, own, repo, browse, entire, as, json, smoke, check, python, topics, resources, conduct, stars, watchers, forks,
Text of the page (most frequently used words):
#python (508), build (304), learn (138), and (117), the (110), phase (80), agent (78), lesson (49), from (41), end (40), for (36), scripts (33), you (32), #scratch (31), llm (31), agents (31), with (31), code (30), skills (30), your (28), lessons (27), python3 (25), engineering (23), mcp (22), type (22), every (21), harness (21), lang (21), github (20), any (20), multi (20), learning (19), vision (19), models (19), use (17), p11 (17), p17 (17), production (17), nlp (16), repo (16), skill (16), rag (16), evaluation (16), json (15), run (15), train (15), language (14), loop (14), multimodal (14), research (14), audio (14), that (13), this (13), security (13), deep (13), attention (13), claude (13), target (13), prompt (13), safety (13), p14 (13), one (12), model (12), path (12), tuning (12), self (12), p13 (12), sub (12), not (11), only (11), name (11), all (11), workbench (11), phases (11), outputs (11), advanced (11), tool (11), eval (11), p18 (11), video (11), com (10), curriculum (10), optimization (10), diffusion (10), install_skills (10), framework (10), open (10), time (9), readme (9), transformers (9), what (9), llms (9), why (9), into (9), real (9), distributed (9), alignment (9), auto (9), p15 (9), memory (9), generation (9), julia (8), loading (8), reload (8), page (8), sponsors (8), rohitg00 (8), ship (8), data (8), text (8), context (8), math (8), each (8), tools (8), fine (8), p10 (8), search (8), typescript (7), there (7), contributing (7), full (7), hours (7), file (7), capstone (7), cursor (7), openclaw (7), layout (7), training (7), pipeline (7), cross (7), vlm (7), token (7), autonomous (7), inference (7), understanding (7), voice (7), architecture (7), speech (7), view (7), can (6), docs (6), 2026 (6), rust (6), license (6), star (6), history (6), directory (6), check (6), setup (6), skip (6), first (6), lesson_run (6), same (6), pack (6), codex (6), hermes (6), files (6), prompts (6), retrieval (6), linear (6), function (6), call (6), decoding (6), level (6), projects (6), fundamentals (6), modeling (6), image (6), enterprise (6), community (5), navigation (5), was (5), error (5), while (5), please (5), more (5), project (5), mit (5), computer (5), non (5), read (5), direct (5), rlhf (5), new (5), know (5), core (5), foundations (5), default (5), actually (5), commit (5), build_catalog (5), task (5), source (5), dry (5), ships (5), reusable (5), add (5), install (5), coding (5), constitutional (5), parallel (5), state (5), metrics (5), query (5), encoder (5), embeddings (5), transformer (5), window (5), genai (5), p12 (5), speculative (5), systems (5), openai (5), frameworks (5), selection (5), features (5), caching (5), benchmarks (5), classification (5), long (5), session (5), feedback (5), building (5), understand (5), actions (5), loss (5), support (5), built (5), other (4), sponsor (4), stars (4), conduct (4), resources (4), generative (4), swarm (4), course (4), machine (4), want (4), sign (4), block (4), get (4), 503 (4), rule (4), schema (4), quiz (4), audit_lessons (4), glossary (4), team (4), anthropic (4), protocol (4), preference (4), gpt (4), are (4), industry (4), start (4), head (4), runs (4), execute (4), per (4), under (4), result (4), workflow (4), catalog (4), tooling (4), writes (4), artifact (4), scaffold_workbench (4), overwrite (4), own (4), reads (4), npx (4), them (4), injection (4), critic (4), gradient (4), instruction (4), observability (4), server (4), p16 (4), document (4), semantic (4), native (4), llama (4), apis (4), stack (4), platform (4), world (4), patterns (4), improvement (4), calling (4), refresh (4), streaming (4), vit (4), networks (4), detection (4), neural (4), intuition (4), msg (4), fig_001 (4), find (4), 3553ff (4), issues (4), action (3), information (3), contributors (3), main (3), report (3), intelligence (3), reinforcement (3), topics (3), aiengineeringfromscratch (3), fork (3), rate (3), rules (3), via (3), logo (3), medium (3), feature (3), coderabbit (3), free (3), work (3), fails (3), shape (3), keys (3), issue (3), inside (3), output (3), before (3), code_of_conduct (3), roadmap (3), track (3), lesson_template (3), forking (3), shot (3), software (3), programming (3), where (3), list (3), automated (3), deps (3), script (3), stdout (3), syntax (3), mode (3), execution (3), most (3), after (3), existing (3), does (3), site (3), verify (3), have (3), top (3), hand (3), minimal (3), force (3), preview (3), init (3), flat (3), tag (3), cloning (3), clone (3), produces (3), yaml (3), content (3), runner (3), decomposition (3), hybrid (3), chunking (3), pretraining (3), layer (3), bpe (3), tokenizer (3), verification (3), plan (3), flow (3), registry (3), complete (3), red (3), devops (3), assistant (3), guard (3), metr (3), stable (3), differential (3), visual (3), family (3), reward (3), serving (3), vllm (3), economics (3), testing (3), cost (3), primitive (3), eagle (3), coordination (3), modes (3), scaling (3), theory (3), debate (3), protocols (3), swarms (3), scale (3), then (3), durable (3), vector (3), graph (3), sampling (3), structured (3), dive (3), whisper (3), prediction (3), weight (3), clip (3), see (3), app (3), methods (3), gans (3), recognition (3), tracking (3), knowledge (3), segmentation (3), pytorch (3), functions (3), algebra (3), algorithm (3), git (3), its (3), yourself (3), paste (3), works (3), write (3), option (3), p19 (3), already (3), but (3), last (3), changelog (3), insights (3), pull (3), requests (3), signed (3), settings (3), another (3), tab (3), saved (3), documentation (3), grade (3), copilot (3), solutions (3), explore (3), personal (2), manage (2), privacy (2), terms (2), footer (2), languages (2), about (2), https (2), releases (2), repository (2), forks (2), activity (2), others (2), maintained (2), attribution (2), required (2), pricing (2), reach (2), above (2), integration (2), 000 (2), linkedin (2), small (2), supported (2), api (2), tweet (2), views (2), twitter (2), exit (2), zero (2), when (2), answer (2), single (2), fix (2), react (2), reasoning (2), chain (2), thought (2), few (2), need (2), consensus (2), will (2), keep (2), getting (2), better (2), creator (2), our (2), fig_003 (2), signal (2), matters (2), stdlib (2), timeout (2), listing (2), reason (2), wired (2), requires (2), heavy (2), editing (2), drift (2), workflows (2), derived (2), counts (2), disk (2), builds (2), out (2), entire (2), edit (2), contract (2), lives (2), handoff (2), drop (2), nested (2), pick (2), filter (2), folder (2), recommended (2), plug (2), homework (2), classifier (2), taxonomy (2), checkpoint (2), resume (2), analysis (2), collective (2), metric (2), classical (2), system (2), precision (2), strategies (2), fusion (2), modality (2), patches (2), demo (2), iteration (2), scheduler (2), paper (2), experiment (2), generator (2), fsdp (2), warmup (2), tokenized (2), corpus (2), large (2), supervised (2), positional (2), dataset (2), sliding (2), tasks (2), gates (2), control (2), over (2), validation (2), combines (2), series (2), tracks (2), range (2), governance (2), chatbot (2), kubernetes (2), scientist (2), asr (2), tts (2), terminal (2), dual (2), risk (2), ecosystem (2), watermarking (2), group (2), bias (2), frontier (2), fsf (2), capability (2), indirect (2), art (2), persistent (2), helps (2), ethics (2), sglang (2), canary (2), deployment (2), gateways (2), prefill (2), routing (2), reduction (2), edge (2), cache (2), quantization (2), awq (2), gptq (2), gguf (2), fp8 (2), nvfp4 (2), gpu (2), modal (2), infrastructure (2), case (2), failure (2), checkpoints (2), mind (2), emergent (2), a2a (2), handoffs (2), orchestration (2), chat (2), speaker (2), role (2), hierarchical (2), supervisor (2), external (2), policy (2), input (2), swe (2), bench (2), evolutionary (2), chatbots (2), horizon (2), initialization (2), still (2), development (2), runtimes (2), collaboration (2), opentelemetry (2), sdk (2), guardrails (2), based (2), flows (2), actor (2), langgraph (2), planning (2), tree (2), principles (2), async (2), client (2), interface (2), temporal (2), autoregressive (2), next (2), dynamic (2), llava (2), resolution (2), patch (2), contrastive (2), hear (2), across (2), machines (2), lora (2), activation (2), deepseek (2), sparse (2), ppo (2), pre (2), mini (2), pipelines (2), wordpiece (2), sentencepiece (2), transfer (2), gradients (2), rectified (2), create (2), decoder (2), rnns (2), everything (2), processing (2), entity (2), subword (2), tokenization (2), topic (2), question (2), sequence (2), cnns (2), object (2), estimation (2), vocabulary (2), pixels (2), debugging (2), introduction (2), stability (2), entropy (2), started (2), bayes (2), curve (2), regression (2), operations (2), vectors (2), through (2), shell (2), docker (2), environments (2), dev (2), environment (2), follows (2), twenty (2), expand (2), contents (2), debugger (2), step (2), explain (2), implement (2), tool_calls (2), because (2), wrote (2), servers (2), here (2), something (2), questions (2), review (2), ten (2), maps (2), starting (2), personalized (2), hour (2), estimates (2), how (2), just (2), ahead (2), theme (2), base (2), themevariables (2), primarycolor (2), fafaf5 (2), primarytextcolor (2), 1a1a1a (2), primarybordercolor (2), linecolor (2), fontfamily (2), jetbrains (2), mono (2), fontsize (2), flowchart (2), line (2), problem (2), raw (2), thing (2), spine (2), doing (2), don (2), pieces (2), vercel (2), requirements (2), txt (2), gitignore (2), web (2), assets (2), 636 (2), commits (2), message (2), menu (2), quality (2), appearance (2), cancel (2), available (2), searches (2), repositories (2), business (2), developer (2), customer (2), services (2), perform, share, cookies, contact, status, inc, html, javascript, packages, blob, published, watching, 239, watchers, tutorial, suggest, ghumare64, rohit, ghumare, however, teach, sell, appreciated, manual, helped, keeps, alive, card, hard, anchors, hero, fold, dedicated, max, partner, platinum, quarterly, gold, listed, provider, 750, silver, row, launch, day, 250, bronze, backers, backer, tier, iii, current, 593, monthly, visitors, 709, acquisition, channel, verified, licensed, sponsorship, alone, cash, l001, l010, validate, presence, emptiness, rejects, legacy, caused, 102, relative, links, choices, friendly, submitting, invariant, progress, template, school, contribute, goal, acting, prompting, instructgpt, denoising, probabilistic, learners, vaswani, 2017, compounds, knowing, boris, cherny, being, remade, front, eyes, andrej, karpathy, hottest, english, foundational, papers, covered, now, senior, engineer, 100, 200, 270, 306, estimated, background, set, override, domains, aggressively, instagram, link_check_skip, domain1, domain2, second, whose, entry, starts, comment, skipped, opt, needs, pkg1, pkg2, strict, 10s, whole, byte, compiles, catches, regressions, introduce, often, bad, indentation, broken, strings, stray, edits, smoke, rebuilds, committed, stale, reject, warn, yml, filesystem, always, match, downstream, drifted, documented, touch, walks, root, truth, browse, seven, surfaces, starter, fresh, init_agent, schema_version, agent_state, task_board, seeds, schemas, scaffold, convention, written, refuses, destination, exits, colliding, collisions, inventory, grouped, manifest, examples, config, without, writing, explicit, useful, filters, offline, custom, whichever, picks, bundle, aware, command, detects, automatically, 388, templates, toolkit, gate, engine, refusal, detector, jailbreak, sharded, atomic, bubble, optimizer, sharding, ddp, ops, leaderboard, aggregation, perplexity, calibration, exec, spec, format, recall, mrr, ndcg, faithfulness, relevance, rewriting, hyde, reranker, bm25, dense, compared, projection, writer, evaluator, literature, hypothesis, save, accumulation, clipping, mixed, cosine, hdf5, downloader, swap, pretrained, weights, assembly, otel, spans, prometheus, fixture, sandbox, denylist, jail, observation, budget, dispatcher, rpc, newline, delimited, stdio, subsystem, tutor, adaptive, scene, dashboard, migration, upgrade, regulated, vertical, troubleshooting, class, codebase, products, cyber, bio, chem, nuclear, moderation, perspective, mats, redwood, apollo, provenance, cards, echoleak, cves, regulatory, korea, synthid, signature, c2pa, fairness, criteria, individual, counterfactual, representational, harm, welfare, rsp, wmdp, garak, pyrit, ascii, jailbreaks, many, jailbreaking, teaming, pair, attacks, scalable, oversight, weak, strong, despite, subversion, faking, scheming, sleeper, deception, mesa, deceptive, rlaif, sycophancy, amplification, hacking, goodhart, law, following, humanity, optional, hosted, cpp, ollama, tgi, finops, unit, tenant, compliance, soc, hipaa, gdpr, act, iso, 42001, secrets, pii, scrubbing, audit, logs, chaos, sre, incident, response, load, llmperf, perf, growthbook, statsig, shadow, progressive, litellm, portkey, kong, bifrost, lmcache, offloading, disaggregated, decode, nvidia, dynamo, batch, discount, standard, ane, hexagon, webgpu, jetson, region, locality, cold, mitigation, serverless, ttft, tpot, itl, goodput, p99, tensorrt, blackwell, radixattention, prefix, workloads, internals, pagedattention, continuous, batching, chunked, autoscaling, karpenter, kai, fireworks, together, baseten, managed, platforms, bedrock, azure, vertex, studies, mast, groupthink, monoculture, queues, durability, economies, incentives, reputation, marl, maddpg, qmix, mappo, pso, aco, simulation, negotiation, bargaining, voting, consistency, topology, byzantine, fault, tolerance, shared, blackboard, routines, stateless, networked, architectures, specialization, planner, executor, verifier, society, orchestrator, worker, pattern, communication, fipa, acl, heritage, acts, emergence, cais, caisi, societal, horizons, preparedness, deepmind, responsible, overrides, rollback, hitl, propose, kill, switches, circuit, breakers, tokens, budgets, caps, governors, running, browser, permission, landscape, codeact, bounded, designs, recursive, aar, workshop, darwin, gödel, modifying, alphaevolve, quiet, taught, briefing, opens, mission, reviewer, separate, builder, marker, runtime, loops, scope, contracts, boundaries, instructions, executable, constraints, capable, fail, driven, queue, event, cron, pve, defense, break, langfuse, phoenix, opik, conventions, pipecat, livekit, cua, gemini, webarena, osworld, gaia, agentbench, agno, mastra, subagents, store, tracing, crewai, crews, autogen, stateful, graphs, htn, libraries, lifelong, voyager, mem0, blocks, sleep, compute, virtual, memgpt, refine, thoughts, lats, reflexion, verbal, rewoo, sdks, auth, enrollment, jwks, audience, pinning, registries, oauth, poisoning, apps, roots, elicitation, transports, design, calls, interfaces, between, colpali, diagram, embodied, vlas, openvla, gr00t, omni, thinker, talker, af3, million, grounding, mio, janus, pro, decoupled, encoders, show, discrete, unified, transfusion, emu3, chameleon, early, internvl3, qwen, fps, onevision, recipes, naflex, flamingo, gated, blip, former, bridge, modalities, tradeoffs, limiting, qlora, reranking, augmented, representations, cot, techniques, put, checkpointing, recomputation, hogwild, jamba, ssm, walkthrough, dualpipe, parallelism, mtp, nsa, walkthroughs, int8, evals, dpo, sft, deepspeed, 124m, tokenizers, games, sim, a2c, a3c, reinforce, dqn, sarsa, monte, carlo, mdps, states, rewards, foundation, game, playing, var, fid, score, matching, inpainting, outpainting, controlnet, conditioning, latent, ddpm, stylegan, conditional, pix2pix, discriminator, autoencoders, vae, images, draft, repeat, variants, laws, flash, mixture, experts, moe, bart, causal, bert, masked, encoding, sinusoidal, rope, alibi, problems, changed, wer, mos, mmau, leaderboards, anti, spoofing, moshi, hibiki, turn, taking, codecs, encodec, snac, mimi, dac, music, conversion, spectrograms, mel, waveforms, fft, speak, dialogue, niah, ruler, longbench, mrcr, ragas, deepeval, relation, extraction, construction, linking, disambiguation, coreference, embedding, nli, textual, entailment, constrained, unigram, multilingual, lda, bertopic, answering, summarization, translation, mechanism, breakthrough, pos, tagging, syntactic, parsing, named, ner, sentiment, glove, fasttext, word, word2vec, bag, words, idf, representation, stemming, lemmatization, monocular, depth, geometry, mlp, sam, gaussian, splatting, keypoint, pose, ocr, simclr, dino, mae, point, clouds, nerfs, instance, mask, cnn, net, yolo, lenet, resnet, convolutions, channels, color, spaces, vlms, jax, schedules, regularization, dropout, decay, batchnorm, optimizers, sgd, momentum, adam, adamw, mse, relu, sigmoid, gelu, backpropagation, forward, pass, perceptron, until, handling, imbalanced, anomaly, naive, hyperparameter, ensemble, boosting, bagging, stacking, variance, unsupervised, means, dbscan, knn, distance, decision, trees, random, forests, logistic, backbone, stochastic, processes, fourier, transform, complex, numbers, convex, statistics, norms, distances, numerical, tensor, singular, value, dimensionality, pca, sne, umap, divergence, descent, theorem, statistical, thinking, probability, distributions, automatic, differentiation, calculus, derivatives, matrix, transformations, eigenvalues, matrices, behind, profiling, linux, management, editor, jupyter, notebooks, cloud, ready, click, given, trace, identify, went, wrong, debug, style, description, steplimitexceeded, raise, return, continue, tool_result, append, args, max_steps, user, def, agent_loop, 120, lines, pure, dependencies, fig_002, worked, sample, lot, portfolio, artifacts, compatible, deploy, workers, expert, help, narrow, curricula, ends, daily, congratulations, learned, eight, specific, placement, prerequisites, selector, intelligently, installed, completed, three, ways, 13px, motto, idea, concrete, pain, concept, diagrams, sklearn, six, beats, split, library, smaller, version, runnable, implementations, narrative, structure, 12px, floor, roof, lower, layers, wonder, breaking, derive, test, five, minute, videos, copy, deploys, holding, laptop, four, gets, backprop, shows, hood, material, teaches, scattered, post, flashy, somewhere, else, rarely, hook, say, readers, days, 241, 669, 150, 639, 320, closes, gap, students, feel, prepared, professionally, which, naturally, assistants, items, latest, date, folders, tags, branches, additional, options, must, change, notification, notifications, public, dismiss, alert, switched, accounts, resetting, focus, qualifiers, results, quickly, submit, include, email, address, contacted, piece, take, very, seriously, provide, tips, clear, users, jump, premium, ons, powered, collections, trending, archive, program, accelerator, maintainer, lab, programs, fund, developers, partners, trust, center, forum, ebooks, reports, events, webinars, stories, industries, government, manufacturing, financial, healthcare, cases, devsecops, modernization, nonprofits, startups, teams, enterprises, company, size, marketplace, blog, stop, leaks, they, secret, protection, secure, vulnerabilities, application, changes, instant, codespaces, automate, integrate, merge, creation, toggle,
Text of the page (random words):
deploys no hand holding free open source and built to run on your own laptop the shape of the curriculum twenty phases stack on top of each other math is the floor agents and production are the roof skip ahead if you already know the lower layers but don t skip and then wonder why something at the top is breaking init theme base themevariables primarycolor fafaf5 primarytextcolor 1a1a1a primarybordercolor 3553ff linecolor 3553ff fontfamily jetbrains mono fontsize 12px flowchart tb p0 phase 0 setup tooling p1 phase 1 math foundations p1 p2 phase 2 ml fundamentals p2 p3 phase 3 deep learning core p3 p4 phase 4 vision p3 p5 phase 5 nlp p3 p6 phase 6 speech audio p3 p9 phase 9 rl p5 p7 phase 7 transformers p7 p8 phase 8 genai p7 p10 phase 10 llms from scratch p10 p11 phase 11 llm engineering p10 p12 phase 12 multimodal p11 p13 phase 13 tools protocols p13 p14 phase 14 agent engineering p14 p15 phase 15 autonomous systems p15 p16 phase 16 multi agent swarms p14 p17 phase 17 infrastructure production p15 p18 phase 18 ethics alignment p16 p19 phase 19 capstone projects p17 p19 p18 p19 loading the shape of a lesson each lesson lives in its own folder with the same structure across the entire curriculum phases nn phase name nn lesson name code runnable implementations python typescript rust julia docs en md lesson narrative outputs prompts skills agents or mcp servers this lesson produces every lesson follows six beats the build it use it split is the spine you implement the algorithm from scratch first then run the same thing through the production library you understand what the framework is doing because you wrote the smaller version yourself init theme base themevariables primarycolor fafaf5 primarytextcolor 1a1a1a primarybordercolor 3553ff linecolor 3553ff fontfamily jetbrains mono fontsize 13px flowchart lr m motto br sub one line core idea sub pr problem br sub concrete pain sub pr c concept br sub diagrams intuition sub c b build it br sub raw math no frameworks sub b u use it br sub same thing in pytorch sklearn sub u s ship it br sub prompt skill agent mcp sub loading getting started three ways in pick one option a read open any completed lesson on aiengineeringfromscratch com or expand a phase under contents no setup no cloning option b clone and run git clone https github com rohitg00 ai engineering from scratch git cd ai engineering from scratch python phases 01 math foundations 01 linear algebra intuition code vectors py option c find your level recommended skip ahead intelligently inside claude cursor codex openclaw hermes or any agent with the curriculum skills installed find your level ten questions maps your knowledge to a starting phase builds a personalized path with hour estimates after each phase check understanding 3 quiz yourself on phase 3 ls phases 03 deep learning core 05 loss functions outputs prompt loss function selector md prompt loss debugger md prerequisites you can write code any language python helps you want to understand how ai actually works not just call apis built in agent skills claude cursor codex openclaw hermes skill what it does find your level ten question placement quiz maps your knowledge to a starting phase and produces a personalized path with hour estimates check understanding phase per phase quiz eight questions with feedback and specific lessons to review every lesson ships something other curricula end with congratulations you learned x each lesson here ends with a reusable tool you can install or paste into your daily workflow fig_001 a prompts fig_001 b skills fig_001 c agents fig_001 d mcp servers paste into any ai assistant for expert level help on a narrow task drop into claude cursor codex openclaw hermes or any agent that reads skill md deploy as autonomous workers you wrote the loop yourself in phase 14 plug into any mcp compatible client built end to end in phase 13 install the lot with python3 scripts install_skills py real tools not homework by the end of the curriculum you have a portfolio of 503 artifacts you actually understand because you built them fig_002 a worked sample phase 14 lesson 1 the agent loop 120 lines of pure python no dependencies code agent_loop py build it def run query tools history user query for step in range max_steps msg llm history if msg tool_calls for call in msg tool_calls result tools call name call args history append tool_result call id result continue return msg content raise steplimitexceeded outputs skill agent loop md ship it name agent loop description react style loop for any tool list phase 14 lesson 01 implement a minimal agent loop that outputs prompt debug agent md you are an agent debugger given the trace of an agent run identify the step where the agent went wrong and explain why contents twenty phases click any phase to expand its lesson list phase 0 setup tooling 12 lessons get your environment ready for everything that follows lesson type lang 01 dev environment build python 02 git collaboration learn 03 gpu setup cloud build python 04 apis keys build python 05 jupyter notebooks build python 06 python environments build shell 07 docker for ai build docker 08 editor setup build 09 data management build python 10 terminal shell learn 11 linux for ai learn 12 debugging profiling build python phase 1 math foundations 22 lessons the intuition behind every ai algorithm through code lesson type lang 01 linear algebra intuition learn python julia 02 vectors matrices operations build python julia 03 matrix transformations eigenvalues build python julia 04 calculus for ml derivatives gradients learn python 05 chain rule automatic differentiation build python 06 probability distributions learn python 07 bayes theorem statistical thinking build python 08 optimization gradient descent family build python 09 information theory entropy kl divergence learn python 10 dimensionality reduction pca t sne umap build python 11 singular value decomposition build python julia 12 tensor operations build python 13 numerical stability build python 14 norms distances build python 15 statistics for ml build python 16 sampling methods build python 17 linear systems build python 18 convex optimization build python 19 complex numbers for ai learn python 20 the fourier transform build python 21 graph theory for ml build python 22 stochastic processes learn python phase 2 ml fundamentals 18 lessons classical ml still the backbone of most production ai lesson type lang 01 what is machine learning learn python 02 linear regression from scratch build python 03 logistic regression classification build python 04 decision trees random forests build python 05 support vector machines build python 06 knn distance metrics build python 07 unsupervised learning k means dbscan build python 08 feature engineering selection build python 09 model evaluation metrics cross validation build python 10 bias variance the learning curve learn python 11 ensemble methods boosting bagging stacking build python 12 hyperparameter tuning build python 13 ml pipelines experiment tracking build python 14 naive bayes build python 15 time series fundamentals build python 16 anomaly detection build python 17 handling imbalanced data build python 18 feature selection build python phase 3 deep learning core 13 lessons neural networks from first principles no frameworks until you build one lesson type lang 01 the perceptron where it all started build python 02 multi layer networks forward pass build python 03 backpropagation from scratch build python 04 activation functions relu sigmoid gelu why build python 05 loss functions mse cross entropy contrastive build python 06 optimizers sgd momentum adam adamw build python 07 regularization dropout weight decay batchnorm build python 08 weight initialization training stability build python 09 learning rate schedules warmup build python 10 build your own mini framework build python 11 introduction to pytorch build python 12 introduction to jax build python 13 debugging neural networks build python phase 4 computer vision 28 lessons from pixels to understanding image video 3d vlms and world models lesson type lang 01 image fundamentals pixels channels color spaces learn python 02 convolutions from scratch build python 03 cnns lenet to resnet build python 04 image classification build python 05 transfer learning fine tuning build python 06 object detection yolo from scratch build python 07 semantic segmentation u net build python 08 instance segmentation mask r cnn build python 09 image generation gans build python 10 image generation diffusion models build python 11 stable diffusion architecture fine tuning build python 12 video understanding temporal modeling build python 13 3d vision point clouds nerfs build python 14 vision transformers vit build python 15 real time vision edge deployment build python 16 build a complete vision pipeline build python 17 self supervised vision simclr dino mae build python 18 open vocabulary vision clip build python 19 ocr document understanding build python 20 image retrieval metric learning build python 21 keypoint detection pose estimation build python 22 3d gaussian splatting from scratch build python 23 diffusion transformers rectified flow build python 24 sam 3 open vocabulary segmentation build python 25 vision language models vit mlp llm build python 26 monocular depth geometry estimation build python 27 multi object tracking video memory build python 28 world models video diffusion build python phase 5 nlp foundations to advanced 29 lessons language is the interface to intelligence lesson type lang 01 text processing tokenization stemming lemmatization build python 02 bag of words tf idf text representation build python 03 word embeddings word2vec from scratch build python 04 glove fasttext subword embeddings build python 05 sentiment analysis build python 06 named entity recognition ner build python 07 pos tagging syntactic parsing build python 08 text classification cnns rnns for text build python 09 sequence to sequence models build python 10 attention mechanism the breakthrough build python 11 machine translation build python 12 text summarization build python 13 question answering systems build python 14 information retrieval search build python 15 topic modeling lda bertopic build python 16 text generation build python 17 chatbots rule based to neural build python 18 multilingual nlp build python 19 subword tokenization bpe wordpiece unigram sentencepiece learn python 20 structured outputs constrained decoding build python 21 nli textual entailment learn python 22 embedding models deep dive learn python 23 chunking strategies for rag build python 24 coreference resolution learn python 25 entity linking disambiguation build python 26 relation extraction knowledge graph construction build python 27 llm evaluation ragas deepeval g eval build python 28 long context evaluation niah ruler longbench mrcr learn python 29 dialogue state tracking build python phase 6 speech audio 17 lessons hear understand speak lesson type lang 01 audio fundamentals waveforms sampling fft learn python 02 spectrograms mel scale audio features build python 03 audio classification build python 04 speech recognition asr build python 05 whisper architecture fine tuning build python 06 speaker recognition verification build python 07 text to speech tts build python 08 voice cloning voice conversion build python 09 music generation build python 10 audio language models build python 11 real time audio processing build python 12 build a voice assistant pipeline build python 13 neural audio codecs encodec snac mimi dac learn python 14 voice activity detection turn taking build python 15 streaming speech to speech moshi hibiki learn python 16 voice anti spoofing audio watermarking build python 17 audio evaluation wer mos mmau leaderboards learn python phase 7 transformers deep dive 14 lessons the architecture that changed everything lesson type lang 01 why transformers the problems with rnns learn python 02 self attention from scratch build python 03 multi head attention build python 04 positional encoding sinusoidal rope alibi build python 05 the full transformer encoder decoder build python 06 bert masked language modeling build python 07 gpt causal language modeling build python 08 t5 bart encoder decoder models learn python 09 vision transformers vit build python 10 audio transformers whisper architecture learn python 11 mixture of experts moe build python 12 kv cache flash attention inference optimization build python 13 scaling laws learn python 14 build a transformer from scratch build python 15 attention variants sliding window sparse differential build python 16 speculative decoding draft verify repeat build python phase 8 generative ai 14 lessons create images video audio 3d and more lesson type lang 01 generative models taxonomy history learn python 02 autoencoders vae build python 03 gans generator vs discriminator build python 04 conditional gans pix2pix build python 05 stylegan build python 06 diffusion models ddpm from scratch build python 07 latent diffusion stable diffusion build python 08 controlnet lora conditioning build python 09 inpainting outpainting editing build python 10 video generation build python 11 audio generation build python 12 3d generation build python 13 flow matching rectified flows build python 14 evaluation fid clip score build python 19 visual autoregressive modeling var next scale prediction build python phase 9 reinforcement learning 12 lessons the foundation of rlhf and game playing ai lesson type lang 01 mdps states actions rewards learn python 02 dynamic programming build python 03 monte carlo methods build python 04 q learning sarsa build python 05 deep q networks dqn build python 06 policy gradients reinforce build python 07 actor critic a2c a3c build python 08 ppo build python 09 reward modeling rlhf build python 10 multi agent rl build python 11 sim to real transfer build python 12 rl for games build python phase 10 llms from scratch 22 lessons build train and understand large language models lesson type lang 01 tokenizers bpe wordpiece sentencepiece build python rust 02 building a tokenizer from scratch build python 03 data pipelines for pre training build python 04 pre training a mini gpt 124m build python 05 distributed training fsdp deepspeed build python 06 instruction tuning sft build python 07 rlhf reward model ppo build python 08 dpo direct preference optimization build python 09 constitutional ai self improvement build python 10 evaluation benchmarks evals build python 11 quantization int8 gptq awq gguf build python 12 inference optimization build python 13 building a complete llm pipeline build python 14 open models architecture walkthroughs learn python 15 speculative decoding and eagle 3 build python 16 differential attention v2 build python 17 native sparse attention deepseek nsa build python 18 multi token prediction mtp build python 19 dualpipe parallelism lea...
|
