The Context Course
The Context Course teaches you context engineering for code agents — the skill of giving agents the right knowledge, tools, and structure to do their best work. Whether you're using Claude Code, Codex, or open source agents, this course will help you get dramatically more out of them.
课时
- projects
- inference
- .agents
- skills
- huggingface-local-models
- skills
- .claude
- .opencode
- .pi
- docs
- Program
- llama.cpp Inference Autoresearch
- research
- Do Not Repeat
- experiments
- Inference Notes
- templates
- .agents
- post-training
- .pi
- docs
- Program
- Post-Training Autoresearch
- research
- src
- eval
- tasks
- nanochat
- task_context
- nanochat
- tasks
- eval
- pre-training
- .agents
- .claude
- .opencode
- .pi
- We made an open source AI lab of agents to train models
- docs
- Program
- Multi-Agent Autoresearch
- research
- campaigns
- Autolab Do-Not-Repeat Ledger
- experiments
- Experiment: Increase embedding weight decay from 0.0005 to 0.001 to test whether stronger regularization on token embeddings improves validation bpb, following the success of the lm_head weight decay increase.
- Experiment: Lower FINAL_LR_FRAC from 0.025 to 0.018 to continue the winning direction of lower final LR floor.
- Experiment: Increase lm_head weight_decay from 0.003 to 0.004 to continue the winning direction of stronger output layer regularization.
- Experiment: Lower MATRIX_LR from 0.042 to 0.038 to test whether slower learning of Muon matrix parameters improves validation bpb.
- Experiment Notes
- Experiment: Lower SCALAR_LR from 0.7 to 0.6 to test whether slower learning of per-layer residual and initial scaling parameters improves validation bpb.
- Experiment: Increase SCALAR_LR from 0.7 to 0.8 to test whether faster learning of per-layer residual and initial scaling parameters improves validation bpb.
- Experiment: Increase UNEMBEDDING_LR from 0.01 to 0.015 to test whether a higher learning rate for the output layer improves validation bpb.
- Experiment: Increase value_embeds weight_decay from 0.004 to 0.005 to test whether stronger regularization on value embeddings improves validation bpb.
- Experiment: Decrease WARMDOWN_RATIO from 0.825 to 0.75 to allow more time at higher learning rates before the final LR floor.
- Autolab Notes
- Hugging Face Paper Ideas
- templates
- Multi-Autoresearch
- inference
- units
- en
- unit0
- unit1
- unit2
- unit3
- unit4
- unit5
- unit6
- en
开始学习 → The Context Course