TEST-INFRA: [ci-execution-time] Investigate increasing parallelism for unit and integration tests #1620

Closed
opened 2026-04-02 23:15:43 +00:00 by freemo · 1 comment
Owner

Metadata

  • Branch: task/ci-execution-time-investigate-parallelism
  • Commit Message: chore(ci): investigate and update default parallel process count for unit and integration tests
  • Milestone: v3.8.0
  • Parent Epic: #376

Description

The unit_tests and integration_tests jobs in the CI pipeline are currently configured to run with a maximum of 2 parallel processes. This is a conservative setting that may be slowing down the CI pipeline unnecessarily.

Task:

Investigate increasing the number of parallel processes for the unit_tests and integration_tests jobs. The number of processes is controlled by the _default_processes() function in noxfile.py.

Acceptance Criteria:

  • The impact of increasing the number of parallel processes on CI execution time is measured and documented.
  • A recommendation is made for a new default number of processes, with supporting data.
  • The _default_processes() function in noxfile.py is updated with the new default.

Subtasks

  • Review the current _default_processes() function in noxfile.py and document the existing default value and rationale.
  • Benchmark CI execution time for unit_tests and integration_tests jobs at the current parallelism setting (2 processes).
  • Benchmark CI execution time at increased parallelism settings (e.g., 4, 8, and CPU-count-based auto-detection).
  • Analyse benchmark results and identify the optimal number of parallel processes, considering both speed and resource stability.
  • Update _default_processes() in noxfile.py with the recommended new default.
  • Run nox (all default sessions) to confirm no regressions are introduced.
  • Verify coverage >= 97% via nox -s coverage_report.
  • Document findings and the chosen default in the PR description.

Definition of Done

  • Benchmark data comparing parallelism settings is captured and included in the PR.
  • A clear recommendation with supporting data is documented.
  • _default_processes() in noxfile.py is updated with the new recommended default.
  • All nox stages pass.
  • Coverage >= 97%.
  • PR is reviewed, approved, and merged.

Automated by CleverAgents Bot
Supervisor: Test Infrastructure | Agent: ca-new-issue-creator

## Metadata - **Branch**: `task/ci-execution-time-investigate-parallelism` - **Commit Message**: `chore(ci): investigate and update default parallel process count for unit and integration tests` - **Milestone**: v3.8.0 - **Parent Epic**: #376 ## Description The `unit_tests` and `integration_tests` jobs in the CI pipeline are currently configured to run with a maximum of 2 parallel processes. This is a conservative setting that may be slowing down the CI pipeline unnecessarily. **Task:** Investigate increasing the number of parallel processes for the `unit_tests` and `integration_tests` jobs. The number of processes is controlled by the `_default_processes()` function in `noxfile.py`. **Acceptance Criteria:** * The impact of increasing the number of parallel processes on CI execution time is measured and documented. * A recommendation is made for a new default number of processes, with supporting data. * The `_default_processes()` function in `noxfile.py` is updated with the new default. ## Subtasks - [ ] Review the current `_default_processes()` function in `noxfile.py` and document the existing default value and rationale. - [ ] Benchmark CI execution time for `unit_tests` and `integration_tests` jobs at the current parallelism setting (2 processes). - [ ] Benchmark CI execution time at increased parallelism settings (e.g., 4, 8, and CPU-count-based auto-detection). - [ ] Analyse benchmark results and identify the optimal number of parallel processes, considering both speed and resource stability. - [ ] Update `_default_processes()` in `noxfile.py` with the recommended new default. - [ ] Run `nox` (all default sessions) to confirm no regressions are introduced. - [ ] Verify coverage >= 97% via `nox -s coverage_report`. - [ ] Document findings and the chosen default in the PR description. ## Definition of Done - [ ] Benchmark data comparing parallelism settings is captured and included in the PR. - [ ] A clear recommendation with supporting data is documented. - [ ] `_default_processes()` in `noxfile.py` is updated with the new recommended default. - [ ] All nox stages pass. - [ ] Coverage >= 97%. - [ ] PR is reviewed, approved, and merged. --- **Automated by CleverAgents Bot** Supervisor: Test Infrastructure | Agent: ca-new-issue-creator
freemo added this to the v3.8.0 milestone 2026-04-02 23:16:13 +00:00
Author
Owner

Closing as duplicate of #1604 (CI setup consolidation). This CI improvement is already tracked.


Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: ca-project-owner

Closing as duplicate of #1604 (CI setup consolidation). This CI improvement is already tracked. --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: ca-project-owner
freemo 2026-04-02 23:31:02 +00:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Reference
cleveragents/cleveragents-core#1620
No description provided.