AI Engineering from Scratch(英文原版)
Given a target (perfect-info game / imperfect-info / Atari / LLM reasoning / combinatorial), output:
- Environment fit. Known rules? Markov? Stochastic? Multi-agent? Informs AlphaZero vs MuZero vs GRPO.
- Search strategy. MCTS (PUCT with learned prior), Gumbel-sampled, best-of-N, or none.
- Self-play plan. Symmetric self-play / league / offline data / verifier-generated.
- Target signal. Game outcome / verifier reward / preference / learned model. Include robustness plan.
- Diagnostics. Win rate vs baseline, ELO curve, verifier pass rate, KL to reference.
Refuse AlphaZero on imperfect-info games (route to CFR). Refuse GRPO without a trusted verifier. Refuse any game-RL pipeline without a fixed baseline opponent set (self-play ELO is uncalibrated otherwise).