perf(tests): add ASV benchmarks for test suite runtime regression tracking #503

Merged
freemo merged 1 commits from perf/asv-test-runtime-benchmarks into master 2026-03-02 14:30:00 +00:00

1 Commits

Author SHA1 Message Date
freemo 69f5b2e3e6 perf(tests): add ASV benchmarks for test suite runtime regression tracking
CI / benchmark-publish (pull_request) Has been skipped
CI / lint (pull_request) Successful in 14s
CI / quality (pull_request) Successful in 16s
CI / build (pull_request) Successful in 16s
CI / typecheck (pull_request) Successful in 33s
CI / security (pull_request) Successful in 45s
CI / unit_tests (pull_request) Successful in 1m52s
CI / docker (pull_request) Successful in 9s
CI / integration_tests (pull_request) Successful in 2m57s
CI / coverage (pull_request) Successful in 3m31s
CI / benchmark-regression (pull_request) Successful in 23m16s
CI / lint (push) Successful in 13s
CI / quality (push) Successful in 16s
CI / build (push) Successful in 19s
CI / security (push) Successful in 29s
CI / typecheck (push) Successful in 34s
CI / benchmark-regression (push) Has been skipped
CI / unit_tests (push) Successful in 1m49s
CI / docker (push) Successful in 38s
CI / integration_tests (push) Successful in 2m46s
CI / coverage (push) Successful in 3m38s
CI / benchmark-publish (push) Has been cancelled
Add ASV benchmark modules to track test suite performance over time:
- bench_unit_tests.py: Feature discovery, step module loading, parallel
  chunk computation, behave config parsing, and test suite metrics
- bench_coverage_report.py: Coverage collection pipeline timing and
  report generation overhead
- bench_subprocess_overhead.py: Subprocess count tracking and per-feature
  startup cost measurement

These benchmarks establish baselines for the post-optimization state
and enable CI-driven regression detection.

ISSUES CLOSED: #486
2026-03-02 14:06:05 +00:00