lars 430917d8f2 train/rollout: submit as remote-GPU HTCondor jobs on TOpAS/NEMO2 ...

Adds `giant train-submit`/`giant rollout-submit`, mirroring `giant analyze
submit`'s CPU-job pattern but for single remote-GPU jobs: +RemoteJob/
RequestGPUs, TARGET.ProvidesEtpCeph instead of the local-only
ProvidesETPResources, and a self-contained condor/ run dir (wrapper, submit
description, and a CondorJobMeta sidecar recording what was submitted and
the assigned cluster id) so a run stays traceable after the fact. Training
jobs re-check for last.pt on every wrapper invocation so a preempted job
resumes instead of restarting.

Also adds `giant new-run` to scaffold a run's config.toml + run dir (with
collision-free naming via the new shared `default_out_dir`) ahead of
submission, and factors router-flag parsing into `_router_cli_overrides`
so `train` and `new-run` resolve it identically.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>

2026-07-24 13:12:01 +02:00

..

test_analysis_reduce.py

Rewrite analysis as streaming rollout-vs-reference plotting pipeline

2026-07-23 17:38:09 +02:00

test_bump_dataset_version.py

Fix ruff, ty, and pytest failures; apply ruff format

2026-07-02 16:59:22 +02:00

test_catalog.py

Rewrite analysis as streaming rollout-vs-reference plotting pipeline

2026-07-23 17:38:09 +02:00

test_cli_new_run.py

train/rollout: submit as remote-GPU HTCondor jobs on TOpAS/NEMO2

2026-07-24 13:12:01 +02:00

test_cli_predict.py

train/rollout: submit as remote-GPU HTCondor jobs on TOpAS/NEMO2

2026-07-24 13:12:01 +02:00

test_condor_gpu.py

train/rollout: submit as remote-GPU HTCondor jobs on TOpAS/NEMO2

2026-07-24 13:12:01 +02:00

test_condor.py

test: replace prep(**_CTX) splat with a typed _prep helper

2026-07-24 11:17:45 +02:00

test_config.py

Apply ruff format and document lint/type tooling in CLAUDE.md

2026-06-18 17:40:27 +02:00

test_create_root_files.py

Support --energy-gev in dwarf make-root for the new minicalosim energy arg

2026-07-13 13:59:09 +02:00

test_dataset.py

Implement Phase 2: secondary particle prediction

2026-06-29 11:34:31 +02:00

test_dwarf.py

Unify dataset/tooling scripts into a single dwarf Typer CLI

2026-07-02 09:52:37 +02:00

test_flow.py

Implement Phase 2: secondary particle prediction

2026-06-29 11:34:31 +02:00

test_geometry.py

Add fast slab lookup for the GeometryOracle, replacing knn as the default

2026-07-08 11:42:12 +02:00

test_loader.py

Apply ruff format after merging phase2-secondary-prediction

2026-07-15 10:00:36 +02:00

test_materials.py

Condition on material/particle physical properties instead of learned embeddings

2026-07-17 15:12:54 +02:00

test_network.py

Implement Phase 2: secondary particle prediction

2026-06-29 11:34:31 +02:00

test_particles.py

Fix crashes in physical-property conditioning edge cases

2026-07-20 10:36:25 +02:00

test_phase2.py

Condition on material/particle physical properties instead of learned embeddings

2026-07-17 15:12:54 +02:00

test_render.py

Rewrite analysis as streaming rollout-vs-reference plotting pipeline

2026-07-23 17:38:09 +02:00

test_rollout.py

Fix crashes in physical-property conditioning edge cases

2026-07-20 10:36:25 +02:00

test_router.py

Condition on material/particle physical properties instead of learned embeddings

2026-07-17 15:12:54 +02:00

test_steps_to_parquet_parallel.py

Fix ruff, ty, and pytest failures; apply ruff format

2026-07-02 16:59:22 +02:00

test_steps_to_parquet.py

Apply ruff format after merging phase2-secondary-prediction

2026-07-15 10:00:36 +02:00

test_transforms.py

Condition on material/particle physical properties instead of learned embeddings

2026-07-17 15:12:54 +02:00

test_validate.py

Fix crashes in physical-property conditioning edge cases

2026-07-20 10:36:25 +02:00

test_wgan.py

Add WGAN-GP mode as a throwaway fast-eval experiment

2026-07-22 11:20:28 +02:00