Experiment: Increase value_embeds weight_decay from 0.004 to 0.005 to test whether stronger regularization on value embeddings improves validation bpb.
Campaign
- Campaign:
regularization-tuning
Hypothesis
Increase value_embeds weight_decay from 0.004 to 0.005 to test whether stronger regularization on value embeddings improves validation bpb.
Parent Context
- Parent master hash:
935fdbf9f4ae8a5ef5bcb76552acea2bc5801965 - Master val_bpb at dispatch:
0.962777 - Worker id:
worker-3 - Worktree:
/Users/ben/code/open-autolab/.runtime/worktrees/value-embeds-wd-005
Single Variable
Expected Upside
Duplicate Check
Runtime
- Log path:
/Users/ben/code/open-autolab/research/live/value-embeds-wd-005.log - Launcher:
uv run scripts/opencode_worker.py run value-embeds-wd-005
Allowed Edit Scope
train.pyonly
Run Plan
- Refresh master with
uv run scripts/refresh_master.py --fetch-dag - Run
uv run scripts/hf_job.py preflight - Run
uv run scripts/hf_job.py launch --mode experiment - Stream logs to the reserved path
- Parse
uv run scripts/parse_metric.py /Users/ben/code/open-autolab/research/live/value-embeds-wd-005.log
Result
- Local val_bpb:
<value> - Submitted:
yes|no - Interpretation:
<one or two sentences> - Failure mode, if any:
<brief note>
Memory-Keeper Handoff
- One short note for
research/notes.md: `` - Any do-not-repeat update: ``