lars
ebd3e0dc71
CI / Lint (ruff check) (push) Successful in 32s
CI / Format (ruff format) (push) Successful in 30s
CI / Sync project version with tag (push) Has been skipped
CI / Type check (ty) (push) Successful in 35s
CI / Lint (ruff check) (pull_request) Successful in 33s
CI / Format (ruff format) (pull_request) Successful in 30s
CI / Type check (ty) (pull_request) Successful in 34s
CI / Sync project version with tag (pull_request) Has been skipped
CI / Tests (push) Successful in 5m59s
CI / Bump version, tag, and update changelog on merge to master (push) Has been skipped
CI / Tests (pull_request) Successful in 4m22s
CI / Bump version, tag, and update changelog on merge to master (pull_request) Has been skipped
giant analyze compares N rollout YAMLs against one shared reference file
(all must name the same dataset, checked up front) instead of exactly one
rollout vs one reference, rendering each rollout as its own colored series
against a single reference line/panel. Series names come from a repeated
--label flag, else the YAML stem, else "rollout" for a single YAML — a
single-rollout run keeps rendering identically to before this change.
Bundle now holds a name-keyed dict of rollout sides instead of one fixed
pair, every catalog compute_partial/finalize builds a Reduced.payload
keyed the same way ("series": {name: ...}, "reference": ... as the one
distinguished non-rollout entry), and every renderer draws N series (or
N panels, for the two heatmap-shaped specs and the router/type-embedding
diagnostics, which are inherently one-matrix/one-checkpoint per rollout)
against the reference's fixed dashed-ink style.
59 lines
1.6 KiB
Python
59 lines
1.6 KiB
Python
"""Rollout-vs-reference analysis: streaming compute + plotstyle rendering.
|
|
|
|
Compares one or more autoregressive ``giant rollout`` runs against a single
|
|
held-out miniCaloSim reference file shared by all of them, producing
|
|
publication-styled comparison plots (one colored series per rollout, one
|
|
reference line) generated in parallel on HTCondor (one job per plot x data
|
|
chunk, compute/merge/render split).
|
|
|
|
Only ``render`` (and the ``render`` CLI path) imports plotstyle/LaTeX; everything
|
|
re-exported here is plotstyle-free so it runs on a compute worker. Import
|
|
``giant.analysis.render`` explicitly for the local render step.
|
|
"""
|
|
|
|
from giant.analysis.catalog import build_catalog, catalog_ids, get_spec
|
|
from giant.analysis.condor import (
|
|
LoadedRollout,
|
|
RunMeta,
|
|
SubmitConfig,
|
|
compute_one,
|
|
compute_reduced,
|
|
derive_run_dir,
|
|
load_rollout_yaml,
|
|
load_rollout_yamls,
|
|
merge_all,
|
|
merge_one,
|
|
prep,
|
|
write_submit,
|
|
)
|
|
from giant.analysis.context import Context, build_context
|
|
from giant.analysis.reduced import Partial, Reduced
|
|
from giant.analysis.runtime_estimate import RUNTIME_SAFETY_MARGIN, estimate_runtime_s
|
|
from giant.analysis.sources import RolloutSpec, Side
|
|
|
|
__all__ = [
|
|
"build_catalog",
|
|
"catalog_ids",
|
|
"get_spec",
|
|
"LoadedRollout",
|
|
"RunMeta",
|
|
"SubmitConfig",
|
|
"compute_one",
|
|
"compute_reduced",
|
|
"derive_run_dir",
|
|
"load_rollout_yaml",
|
|
"load_rollout_yamls",
|
|
"merge_all",
|
|
"merge_one",
|
|
"prep",
|
|
"write_submit",
|
|
"Context",
|
|
"build_context",
|
|
"Partial",
|
|
"Reduced",
|
|
"RolloutSpec",
|
|
"Side",
|
|
"RUNTIME_SAFETY_MARGIN",
|
|
"estimate_runtime_s",
|
|
]
|