TEST-INFRA: [ci-execution-time] Increase default parallelism for unit and integration tests #2283

Closed
opened 2026-04-03 12:49:43 +00:00 by freemo · 1 comment
Owner

Metadata

  • Branch: chore/ci-increase-default-test-parallelism
  • Commit Message: chore(nox): increase default parallelism for unit and integration test sessions
  • Milestone: v3.8.0
  • Parent Epic: #1678

Summary

The unit_tests and integration_tests nox sessions use a conservative default of only 2 processes for parallel execution. This is likely underutilizing the available CPU cores on the CI runners, leading to longer than necessary execution times.

The _default_processes function in noxfile.py is hardcoded to min(cpus, 2).

Subtasks

  • Modify the _default_processes function in noxfile.py to use a more appropriate default, such as os.cpu_count().
  • Investigate if there are any resource contention issues when running with higher parallelism and address them if necessary.
  • Run nox (all default sessions), fix any errors.
  • Verify coverage >=97% via nox -s coverage_report.

Definition of Done

  • The default number of processes for parallel test execution is increased.
  • The CI execution time for the unit_tests and integration_tests jobs is reduced.
  • All nox stages pass.
  • Coverage >= 97%.
  • A Git commit is created where the first line of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details about the implementation.
  • The commit is pushed to the remote on the branch matching the Branch in Metadata exactly.
  • The commit is submitted as a pull request to master, reviewed, and merged before this issue is marked done.

Automated by CleverAgents Bot
Supervisor: Test Infrastructure | Agent: ca-new-issue-creator

## Metadata - **Branch**: `chore/ci-increase-default-test-parallelism` - **Commit Message**: `chore(nox): increase default parallelism for unit and integration test sessions` - **Milestone**: v3.8.0 - **Parent Epic**: #1678 ## Summary The `unit_tests` and `integration_tests` nox sessions use a conservative default of only 2 processes for parallel execution. This is likely underutilizing the available CPU cores on the CI runners, leading to longer than necessary execution times. The `_default_processes` function in `noxfile.py` is hardcoded to `min(cpus, 2)`. ## Subtasks - [ ] Modify the `_default_processes` function in `noxfile.py` to use a more appropriate default, such as `os.cpu_count()`. - [ ] Investigate if there are any resource contention issues when running with higher parallelism and address them if necessary. - [ ] Run `nox` (all default sessions), fix any errors. - [ ] Verify coverage >=97% via `nox -s coverage_report`. ## Definition of Done - [ ] The default number of processes for parallel test execution is increased. - [ ] The CI execution time for the `unit_tests` and `integration_tests` jobs is reduced. - [ ] All nox stages pass. - [ ] Coverage >= 97%. - [ ] A Git commit is created where the **first line** of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details about the implementation. - [ ] The commit is pushed to the remote on the branch matching the **Branch** in Metadata exactly. - [ ] The commit is submitted as a **pull request** to `master`, reviewed, and **merged** before this issue is marked done. --- **Automated by CleverAgents Bot** Supervisor: Test Infrastructure | Agent: ca-new-issue-creator
freemo added this to the v3.8.0 milestone 2026-04-03 12:49:54 +00:00
Author
Owner

Closing as duplicate of #2333.

This issue ("Increase default parallelism for unit and integration tests") covers the same scope as #2333 ("Investigate and increase test parallelism"). Consolidating to avoid duplicate work.


Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: ca-project-owner

Closing as duplicate of #2333. This issue ("Increase default parallelism for unit and integration tests") covers the same scope as #2333 ("Investigate and increase test parallelism"). Consolidating to avoid duplicate work. --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: ca-project-owner
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Reference
cleveragents/cleveragents-core#2283
No description provided.