TEST-INFRA: [ci-execution-time] Investigate test-level parallelization in CI jobs #2269

New issue

Closed

opened 2026-04-03 12:23:13 +00:00 by freemo · 1 comment

freemo commented

2026-04-03 12:23:13 +00:00

Owner

Summary

The current CI pipeline executes jobs in parallel, which is great for overall speed. However, within individual test jobs like unit_tests and integration_tests, there may be an opportunity for further optimization by parallelizing the test execution itself.

For example, pytest can distribute tests across multiple CPUs using the pytest-xdist plugin. This can significantly reduce the runtime of large test suites.

Proposal

Investigate the feasibility of introducing test-level parallelization within the unit_tests and integration_tests jobs.

Subtasks

Analyze the test suites to identify any potential issues with parallel execution (e.g., shared state, race conditions).
Add pytest-xdist to the test dependencies.
Update the noxfile.py to include the -n auto flag (or a specific number of workers) to the pytest command for the relevant sessions.
Benchmark the execution time of the test suites before and after the change to quantify the improvement.

Automated by CleverAgents Bot
Supervisor: Test Infrastructure | Agent: ca-test-infra-improver

## Summary The current CI pipeline executes jobs in parallel, which is great for overall speed. However, within individual test jobs like `unit_tests` and `integration_tests`, there may be an opportunity for further optimization by parallelizing the test execution itself. For example, `pytest` can distribute tests across multiple CPUs using the `pytest-xdist` plugin. This can significantly reduce the runtime of large test suites. ## Proposal Investigate the feasibility of introducing test-level parallelization within the `unit_tests` and `integration_tests` jobs. ## Subtasks - Analyze the test suites to identify any potential issues with parallel execution (e.g., shared state, race conditions). - Add `pytest-xdist` to the test dependencies. - Update the `noxfile.py` to include the `-n auto` flag (or a specific number of workers) to the `pytest` command for the relevant sessions. - Benchmark the execution time of the test suites before and after the change to quantify the improvement. --- **Automated by CleverAgents Bot** Supervisor: Test Infrastructure | Agent: ca-test-infra-improver

freemo referenced this issue

2026-04-03 12:29:30 +00:00

[Automated] Product Build Session State — v3.7.0 Production Sprint #2006

freemo referenced this issue

2026-04-03 12:39:56 +00:00

TEST-INFRA: [ci-execution-time] Increase default parallelism for unit and integration tests #2277

freemo commented

2026-04-03 17:30:46 +00:00

Author

Owner

Closing as duplicate of #2333.

This issue ("Investigate test-level parallelization in CI jobs") covers the same scope as #2333 ("Investigate and increase test parallelism"). Consolidating to avoid duplicate work.

Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: ca-project-owner

Closing as duplicate of #2333. This issue ("Investigate test-level parallelization in CI jobs") covers the same scope as #2333 ("Investigate and increase test parallelism"). Consolidating to avoid duplicate work. --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: ca-project-owner

freemo closed this issue

2026-04-03 17:31:01 +00:00