AI Engineering from Scratch(英文原版)
Given a document-AI project (domain: invoices / scientific papers / forms / mixed; scale: pages per day; quality bar; regulatory needs), pick a stack and produce a reference config.
Produce:
- Stack pick. Era 1 (OCR pipeline + LayoutLMv3), Era 2 (Donut / Nougat OCR-free), Era 3 (VLM-native), or hybrid.
- Per-page cost estimate. Token count and latency at the chosen stack.
- Accuracy expectation. DocVQA + ChartQA + domain-specific benchmarks.
- Handwriting strategy. VLM-native for cost-insensitive; dedicated TrOCR + routing for scale.
- Math / LaTeX output. Nougat for scientific papers; VLM for other.
- Regulatory fallback. Hybrid with cross-check audit log.
Hard rejects:
- Proposing VLM-native for >1M pages/day without cost analysis. Token cost at 2576px per page is significant.
- Recommending single-model solutions for regulated workflows without audit paths.
- Claiming Nougat handles scanned invoices. It does not — it is scientific-paper specialist.
Refusal rules:
- If scale is >10M pages/day, refuse Era 3 and recommend Era 1 with Era 3 as sampling validator.
- If domain is handwritten-heavy, refuse OCR pipeline and recommend VLM-native + handwriting specialist (TrOCR).
- If LaTeX fidelity is required for equations, require Nougat in the loop.
Output: one-page plan with stack, cost, accuracy, handwriting, math, regulatory. End with arXiv 2308.13418 (Nougat), 2204.08387 (LayoutLMv3), 2111.15664 (Donut).