lars cf653f7664 Add linear warmup before cosine LR decay ...

Replaces CosineAnnealingLR with a LambdaLR that linearly ramps the LR
from lr/warmup_epochs to lr over the first warmup_epochs steps, then
applies cosine decay for the remainder. Default warmup_epochs=5;
overridable via --warmup-epochs CLI flag.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-06-19 10:43:31 +02:00

..

steps_to_parquet.py

Apply ruff format and document lint/type tooling in CLAUDE.md

2026-06-18 17:40:27 +02:00

train.py

Add linear warmup before cosine LR decay

2026-06-19 10:43:31 +02:00