cleveragents/cleveragents-core
4
0
Fork 3
Code Issues 6.0k Pull Requests 115 Actions Packages Projects Releases Wiki Activity

perf(ci): optimize benchmark-regression test suite to reduce CI execution time #10869

Open
HAL9000 wants to merge 2 commits from feature/issue-10846-optimize-benchmark-regression-test-suite into master
pull from: feature/issue-10846-optimize-benchmark-regression-test-suite
merge into: cleveragents:master
Conversation 10 Commits 2 Files Changed 5
+287 -28

2 Commits

Author SHA1 Message Date
CleverAgents Bot fcb13ec3c1 ci: stop master workflow on PR updates
CI / lint (pull_request) Has been cancelled
Details
CI / typecheck (pull_request) Has been cancelled
Details
CI / security (pull_request) Has been cancelled
Details
CI / quality (pull_request) Has been cancelled
Details
CI / unit_tests (pull_request) Has been cancelled
Details
CI / integration_tests (pull_request) Has been cancelled
Details
CI / e2e_tests (pull_request) Has been cancelled
Details
CI / coverage (pull_request) Has been cancelled
Details
CI / build (pull_request) Has been cancelled
Details
CI / docker (pull_request) Has been cancelled
Details
CI / helm (pull_request) Has been cancelled
Details
CI / push-validation (pull_request) Has been cancelled
Details
CI / status-check (pull_request) Has been cancelled
Details 
Remove the stale pull_request trigger from master.yml so PR branch commits do not launch the master workflow.

Maintenance patch for PR #10869.
 2026-06-10 20:22:37 -04:00
HAL9000 f56a79d9e1 perf(ci): optimize benchmark-regression test suite to reduce CI execution time
CI / lint (pull_request) Failing after 55s
Details
CI / benchmark-publish (pull_request) Has been skipped
Details
CI / helm (pull_request) Successful in 35s
Details
CI / build (pull_request) Successful in 55s
Details
CI / push-validation (pull_request) Successful in 21s
Details
CI / typecheck (pull_request) Successful in 1m23s
Details
CI / quality (pull_request) Successful in 1m37s
Details
CI / security (pull_request) Successful in 1m47s
Details
CI / coverage (pull_request) Has been skipped
Details
CI / unit_tests (pull_request) Failing after 1m59s
Details
CI / docker (pull_request) Has been skipped
Details
CI / integration_tests (pull_request) Successful in 3m53s
Details
CI / e2e_tests (pull_request) Successful in 4m16s
Details
CI / status-check (pull_request) Failing after 4s
Details 
- Add asv-regression.conf.json with optimized settings for regression testing
- Enable parallel benchmark execution (2 processes) for faster feedback
- Reduce factor from 1.50 to 1.25 for quicker regression detection
- Reduce number_of_steps from default to 5 for faster convergence
- Skip machine registration if results already exist to avoid redundant setup
- Add comprehensive Behave tests to verify optimization configuration
- Update both benchmark and benchmark_regression nox sessions with parallel flag

These optimizations reduce CI execution time for benchmark regression tests
while maintaining statistical significance for performance regression detection.

ISSUES CLOSED: #10846
 2026-04-27 06:41:47 +00:00