lars 759b67a9e1 Speed up _WelfordAccumulator's per-chunk update ...

The streaming update re-derived two full (B, F) arrays from the
running mean (once before updating it, once after) plus an elementwise
product — five passes over each chunk and three temporary arrays, to
maintain a mean/variance that's tiny in width (COND_DIM=15 at most).

Reformulate as Chan/Golub/LeVeque's parallel-variance algorithm:
compute the chunk's own local mean/M2 (independent of the running
state) and merge it in with an O(F) combination formula. Same
streaming interface and output (identical to ~1e-14, float64 rounding
noise), ~40% faster per update() call on a benchmark chunk.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>

2026-07-29 13:55:07 +02:00

..

test_analysis_reduce.py

Rewrite analysis as streaming rollout-vs-reference plotting pipeline

2026-07-23 17:38:09 +02:00

test_bump_dataset_version.py

Fix ruff, ty, and pytest failures; apply ruff format

2026-07-02 16:59:22 +02:00

test_catalog.py

analyze: chunk per-plot aggregation across HTCondor jobs

2026-07-27 09:24:19 +02:00

test_cli_predict.py

Add --comment option to predict, recorded in YAML sidecar

2026-07-06 09:37:48 +02:00

test_condor.py

analyze: default run directory to <repo>/analysis_runs, gitignored

2026-07-27 11:29:35 +02:00

test_config.py

Add test coverage for resolve_expert_dims

2026-07-29 10:42:44 +02:00

test_create_root_files.py

Support --energy-gev in dwarf make-root for the new minicalosim energy arg

2026-07-13 13:59:09 +02:00

test_dataset.py

Implement Phase 2: secondary particle prediction

2026-06-29 11:34:31 +02:00

test_dwarf.py

Unify dataset/tooling scripts into a single dwarf Typer CLI

2026-07-02 09:52:37 +02:00

test_flow.py

Implement Phase 2: secondary particle prediction

2026-06-29 11:34:31 +02:00

test_geometry.py

Add fast slab lookup for the GeometryOracle, replacing knn as the default

2026-07-08 11:42:12 +02:00

test_loader.py

Add regression coverage for vocab/process index-map builders

2026-07-29 13:45:33 +02:00

test_materials.py

Condition on material/particle physical properties instead of learned embeddings

2026-07-17 15:12:54 +02:00

test_network.py

Implement Phase 2: secondary particle prediction

2026-06-29 11:34:31 +02:00

test_particles.py

Fix crashes in physical-property conditioning edge cases

2026-07-20 10:36:25 +02:00

test_phase2.py

Speed up giant train's setup stage

2026-07-29 13:34:32 +02:00

test_render.py

Rewrite analysis as streaming rollout-vs-reference plotting pipeline

2026-07-23 17:38:09 +02:00

test_rollout.py

Fix crashes in physical-property conditioning edge cases

2026-07-20 10:36:25 +02:00

test_router_gating.py

analyze: add MoE router gating/share diagnostic plots

2026-07-24 13:32:25 +02:00

test_router.py

router: seed EnergyRouter centers from data quantiles instead of a fixed linspace

2026-07-27 13:11:16 +02:00

test_steps_to_parquet_parallel.py

Fix ruff, ty, and pytest failures; apply ruff format

2026-07-02 16:59:22 +02:00

test_steps_to_parquet.py

Apply ruff format after merging phase2-secondary-prediction

2026-07-15 10:00:36 +02:00

test_transforms.py

Speed up _WelfordAccumulator's per-chunk update

2026-07-29 13:55:07 +02:00

test_validate.py

Fix crashes in physical-property conditioning edge cases

2026-07-20 10:36:25 +02:00

test_wgan.py

Add WGAN-GP mode as a throwaway fast-eval experiment

2026-07-22 11:20:28 +02:00