lars c3b7b2744c Batch StreamingStepsDataset internally instead of per-row collate ...

The dataset yielded one row at a time, forcing DataLoader's default
collate to Python-loop over every row to assemble each batch. That
loop scales with batch size and was pinning a CPU core at 100% while
the GPU sat idle. Now the dataset yields whole batches via vectorized
numpy slicing, used with DataLoader(batch_size=None).

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-06-18 10:08:36 +02:00

..

steps_to_parquet.py

Add ROOT-to-parquet conversion script with convert dependency group

2026-06-17 11:27:49 +02:00

train.py

Batch StreamingStepsDataset internally instead of per-row collate

2026-06-18 10:08:36 +02:00