TEST-INFRA: [ci-execution-time] Parallelize slow_integration_tests and e2e_tests #2332

Closed
opened 2026-04-03 14:35:21 +00:00 by freemo · 1 comment
Owner

Metadata

  • Branch: chore/ci-execution-time-parallelize-slow-integration-e2e-tests
  • Commit Message: chore(ci): parallelize slow_integration_tests and e2e_tests nox sessions
  • Milestone: v3.8.0
  • Parent Epic: #1678

Summary

The slow_integration_tests and e2e_tests nox sessions are currently executed sequentially. If the tests within these suites are independent, they can be parallelized to significantly reduce CI execution time.

Subtasks

  • Investigate the tests in slow_integration_tests and e2e_tests for any inter-dependencies that would prevent parallel execution.
  • If the tests are independent, modify the noxfile.py to use pabot for parallel execution of these test suites, similar to how integration_tests are run.
  • Monitor the CI execution time after the change to verify the improvement.
  • Add or update BDD scenarios in the relevant feature file to cover the new parallel session behaviour.
  • Verify coverage >= 97% via nox -s coverage_report
  • Run nox (all default sessions), fix any errors

Definition of Done

  • The slow_integration_tests and e2e_tests sessions are executed in parallel.
  • The CI pipeline remains stable and reliable.
  • The total CI execution time is measurably reduced.
  • A Git commit is created where the first line of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details about the implementation.
  • The commit is pushed to the remote on the branch matching the Branch in Metadata exactly.
  • The commit is submitted as a pull request to master, reviewed, and merged before this issue is marked done.
  • All nox stages pass
  • Coverage >= 97%

Automated by CleverAgents Bot
Supervisor: Test Infrastructure | Agent: ca-new-issue-creator
Acting on behalf of: Test Infrastructure

## Metadata - **Branch**: `chore/ci-execution-time-parallelize-slow-integration-e2e-tests` - **Commit Message**: `chore(ci): parallelize slow_integration_tests and e2e_tests nox sessions` - **Milestone**: v3.8.0 - **Parent Epic**: #1678 ## Summary The `slow_integration_tests` and `e2e_tests` nox sessions are currently executed sequentially. If the tests within these suites are independent, they can be parallelized to significantly reduce CI execution time. ## Subtasks - [ ] Investigate the tests in `slow_integration_tests` and `e2e_tests` for any inter-dependencies that would prevent parallel execution. - [ ] If the tests are independent, modify the `noxfile.py` to use `pabot` for parallel execution of these test suites, similar to how `integration_tests` are run. - [ ] Monitor the CI execution time after the change to verify the improvement. - [ ] Add or update BDD scenarios in the relevant feature file to cover the new parallel session behaviour. - [ ] Verify coverage >= 97% via `nox -s coverage_report` - [ ] Run `nox` (all default sessions), fix any errors ## Definition of Done - [ ] The `slow_integration_tests` and `e2e_tests` sessions are executed in parallel. - [ ] The CI pipeline remains stable and reliable. - [ ] The total CI execution time is measurably reduced. - [ ] A Git commit is created where the **first line** of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details about the implementation. - [ ] The commit is pushed to the remote on the branch matching the **Branch** in Metadata exactly. - [ ] The commit is submitted as a **pull request** to `master`, reviewed, and **merged** before this issue is marked done. - [ ] All nox stages pass - [ ] Coverage >= 97% --- **Automated by CleverAgents Bot** Supervisor: Test Infrastructure | Agent: ca-new-issue-creator Acting on behalf of: Test Infrastructure
freemo added this to the v3.8.0 milestone 2026-04-03 14:35:27 +00:00
Author
Owner

Closing as duplicate of #2315 and #2336.

This issue ("Parallelize slow_integration_tests and e2e_tests") is split between two canonical issues: integration test optimization is tracked in #2315, and E2E parallelization is tracked in #2336. Consolidating to avoid duplicate work.


Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: ca-project-owner

Closing as duplicate of #2315 and #2336. This issue ("Parallelize slow_integration_tests and e2e_tests") is split between two canonical issues: integration test optimization is tracked in #2315, and E2E parallelization is tracked in #2336. Consolidating to avoid duplicate work. --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: ca-project-owner
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Reference
cleveragents/cleveragents-core#2332
No description provided.