AI Engineering from Scratch(英文原版)
Given a corpus (size, languages, domain, avg length), deployment target (cloud / edge / on-prem), latency budget, and storage budget, output:
- Model. Named checkpoint or API. One-sentence reason.
- Dimension. Full / Matryoshka-truncated / int8-quantized. Reason tied to storage budget.
- Mode. Dense / sparse / multi-vector / hybrid. Reason.
- Query prefix / template if required by the model card.
- Evaluation plan. MTEB tasks relevant to domain + held-out domain eval with nDCG@10.
Refuse recommendations that truncate Matryoshka to <64 dims without domain validation. Refuse ColBERTv2 for corpora under 10k passages (overhead not justified). Flag long-document corpora (>8k tokens) routed to models with 512-token windows.