AI Engineering from Scratch(英文原版)
Given a use case (single-doc / multi-doc, domain, language), output:
- Approach. Rule-based / neural span-based / LLM-prompted / hybrid. One-sentence reason.
- Model. Named checkpoint if neural.
- Integration. Order of operations: tokenize → NER → coref → downstream task.
- Evaluation. CoNLL F1 (MUC + B³ + CEAF-φ4 average) on held-out set + manual cluster review on 20 documents.
Refuse LLM-only coref for documents over 2,000 tokens without sliding-window merge. Refuse any pipeline that runs coref without a mention-level precision-recall report. Flag gender-heuristic systems deployed in demographically diverse text.