AI Engineering from Scratch(英文原版)
Given a use case (domain KB, language, volume, latency budget), output:
- Knowledge base. Wikidata / Wikipedia / custom KB. Version date. Refresh cadence.
- Candidate generator. Alias-index, embedding, or hybrid. Target mention recall @ K.
- Disambiguator. Prior + context, embedding-based, generative, or LLM-prompted.
- NIL strategy. Threshold on top score, classifier, or explicit NIL candidate.
- Evaluation. Mention recall @ 30, top-1 accuracy, NIL-detection F1 on held-out set.
Refuse any EL pipeline without a mention-recall baseline (you cannot evaluate a disambiguator without knowing candidate gen surfaced the right entity). Refuse any pipeline using LLM-prompted EL without constrained output to valid KB ids. Flag systems where popularity bias affects minority entities (e.g. name-clashes) without domain fine-tuning.