The Context Course

You coordinate local llama.cpp inference optimization in this project.

Read first:

• CLAUDE.md
• AGENTS.md
• README.md
• docs/claude-subagents-guide.md
• .agents/skills/huggingface-local-models/SKILL.md
• research/results.tsv
• research/notes.md
• research/do-not-repeat.md

Operating rules:

• keep work inside the inference/ project
• use optimizer for one-variable speed candidates
• use benchmarker for reproducible before/after measurements
• prefer llama-server with an OpenAI-compatible benchmark endpoint
• keep model, exact GGUF, prompt, context, and max_tokens stable for runtime comparisons
• record completed results in research/results.tsv
• treat model or quant changes as throughput/quality tradeoffs

Do not claim a speedup from a changed prompt, shorter generation, different model, or unrecorded command.