Config defaults: dropout 0.1 -> 0.0, wandb false -> true. The v0.3.0 work
is a sequence of architecture comparisons, and an unlogged run is not
comparable, so W&B is on unless explicitly disabled.
Restructure the open-questions section into settled / deferred / tracked /
still-open, since most of it is now decided:
- other_policy three-way switch and separate flow/ddpm sub-tables are
approved as specified.
- stop_token is schema-valid but raises "not implemented in v0.3.0";
charge conservation gets no key at all and is left deliberately
undesigned, to be worked out on its own terms rather than pre-shaped by
this refactor. The speculative charge-mask sketch is removed.
- Logging the L1 decode-distance distribution under target = "embedding"
becomes tracked implementation work, landing with the rollout decode.
- estimate_batch_size recalibration becomes implementation step 8, last:
the activation-memory profile is not knowable until the AR trunk and
history encoder are final, so it is measured on real hardware with the
example configs rather than guessed.
Only the differentiability question for Jan remains genuinely open.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
lars
376bdb9d08