perf: defer heavy imports in giant/dwarf CLIs until commands run #91

Merged

lars merged 2 commits from cli-lazy-imports into master 2026-08-28 14:21:10 +02:00

Conversation 0 Commits 2 Files Changed 4

+106 -54

lars commented 2026-08-28 14:11:00 +02:00

Owner

Copy Link

Copy Source

torch/pandas/pyarrow/polars/uproot/awkward/particle were all imported
at module scope in giant/cli.py and giant/tools/dwarf.py, so even
--help paid ~1.6-1.9s of import cost. Move those imports into the
command bodies that actually need them (following the deferred-import
pattern already used for analysis/render/plots/sklearn/wandb), cutting
giant --help to ~0.3s and dwarf --help to ~0.2s with no change to
any command's actual behavior.

Co-Authored-By: Claude Sonnet 5 noreply@anthropic.com

torch/pandas/pyarrow/polars/uproot/awkward/particle were all imported at module scope in giant/cli.py and giant/tools/dwarf.py, so even `--help` paid ~1.6-1.9s of import cost. Move those imports into the command bodies that actually need them (following the deferred-import pattern already used for analysis/render/plots/sklearn/wandb), cutting `giant --help` to ~0.3s and `dwarf --help` to ~0.2s with no change to any command's actual behavior. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>

lars added 1 commit 2026-08-28 14:11:01 +02:00

perf: defer heavy imports in giant/dwarf CLIs until commands run ... 516a8a9ee1

torch/pandas/pyarrow/polars/uproot/awkward/particle were all imported
at module scope in giant/cli.py and giant/tools/dwarf.py, so even
`--help` paid ~1.6-1.9s of import cost. Move those imports into the
command bodies that actually need them (following the deferred-import
pattern already used for analysis/render/plots/sklearn/wandb), cutting
`giant --help` to ~0.3s and `dwarf --help` to ~0.2s with no change to
any command's actual behavior.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>

lars added 1 commit 2026-08-28 14:11:19 +02:00

Merge branch 'master' into cli-lazy-imports 8d1c29efdd

lars merged commit 70d018982b into master 2026-08-28 14:21:10 +02:00

lars deleted branch cli-lazy-imports 2026-08-28 14:21:11 +02:00

Sign in to join this conversation.

Reviewers

No Reviewers

Labels

Clear labels

architecture

bug

Silent/wrong behavior, no crash

experiment

feature

New feature matching the v0.3 redesign

investigation

modularity

Making the network genuinely pluggable

performance

phase2

validation

wontfix

Not being fixed right now

No Label

Milestone

No items

No Milestone

Projects

Clear projects

No project

Assignees

Clear assignees

lars (Lars Bogner)

No Assignees

1 Participants

Notifications

Subscribe

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: lars/giant#91