TEST-INFRA: [ci-pipeline-design] Split large test suites into smaller, parallel jobs #2469

Open
opened 2026-04-03 18:33:47 +00:00 by freemo · 1 comment
Owner

Metadata

  • Branch: test/v3.8.0-split-parallel-test-jobs
  • Commit Message: test(ci-pipeline-design): split monolithic test suite jobs into parallel CI jobs
  • Milestone: v3.8.0
  • Parent Epic: #1678

Background and Context

The unit_tests, integration_tests, and e2e_tests jobs in the CI pipeline are monolithic and can take a long time to run. This slows down the feedback loop for developers and increases the time-to-merge for pull requests. Splitting these jobs into smaller, parallel jobs will reduce total CI run time and improve developer experience.

Expected Behavior

Each of the three monolithic test jobs (unit_tests, integration_tests, e2e_tests) is broken into smaller, parallel sub-jobs (e.g., partitioned by directory or test type), so that the CI pipeline completes faster and failures are easier to isolate.

Subtasks

  • Audit the unit_tests job and identify logical split points (e.g., by top-level package directory or test category).
  • Split the unit_tests job into smaller, parallel jobs.
  • Audit the integration_tests job and identify logical split points.
  • Split the integration_tests job into smaller, parallel jobs.
  • Audit the e2e_tests job and identify logical split points.
  • Split the e2e_tests job into smaller, parallel jobs.
  • Verify all parallel jobs pass on a feature branch CI run.
  • Measure and document the reduction in total CI run time.
  • Run nox (all default sessions), fix any errors.
  • Verify coverage >= 97% via nox -s coverage_report.

Definition of Done

  • The unit_tests, integration_tests, and e2e_tests jobs are each split into smaller, parallel jobs in the CI pipeline configuration.
  • The CI pipeline runs successfully with the new parallel test jobs.
  • The total CI run time is measurably reduced.
  • A Git commit is created where the first line of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details about the implementation.
  • The commit is pushed to the remote on the branch matching the Branch in Metadata exactly.
  • The commit is submitted as a pull request to master, reviewed, and merged before this issue is marked done.
  • All nox stages pass
  • Coverage >= 97%

Automated by CleverAgents Bot
Supervisor: Test Infrastructure | Agent: ca-new-issue-creator

## Metadata - **Branch**: `test/v3.8.0-split-parallel-test-jobs` - **Commit Message**: `test(ci-pipeline-design): split monolithic test suite jobs into parallel CI jobs` - **Milestone**: v3.8.0 - **Parent Epic**: #1678 ## Background and Context The `unit_tests`, `integration_tests`, and `e2e_tests` jobs in the CI pipeline are monolithic and can take a long time to run. This slows down the feedback loop for developers and increases the time-to-merge for pull requests. Splitting these jobs into smaller, parallel jobs will reduce total CI run time and improve developer experience. ## Expected Behavior Each of the three monolithic test jobs (`unit_tests`, `integration_tests`, `e2e_tests`) is broken into smaller, parallel sub-jobs (e.g., partitioned by directory or test type), so that the CI pipeline completes faster and failures are easier to isolate. ## Subtasks - [ ] Audit the `unit_tests` job and identify logical split points (e.g., by top-level package directory or test category). - [ ] Split the `unit_tests` job into smaller, parallel jobs. - [ ] Audit the `integration_tests` job and identify logical split points. - [ ] Split the `integration_tests` job into smaller, parallel jobs. - [ ] Audit the `e2e_tests` job and identify logical split points. - [ ] Split the `e2e_tests` job into smaller, parallel jobs. - [ ] Verify all parallel jobs pass on a feature branch CI run. - [ ] Measure and document the reduction in total CI run time. - [ ] Run `nox` (all default sessions), fix any errors. - [ ] Verify coverage >= 97% via `nox -s coverage_report`. ## Definition of Done - [ ] The `unit_tests`, `integration_tests`, and `e2e_tests` jobs are each split into smaller, parallel jobs in the CI pipeline configuration. - [ ] The CI pipeline runs successfully with the new parallel test jobs. - [ ] The total CI run time is measurably reduced. - [ ] A Git commit is created where the **first line** of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details about the implementation. - [ ] The commit is pushed to the remote on the branch matching the **Branch** in Metadata exactly. - [ ] The commit is submitted as a **pull request** to `master`, reviewed, and **merged** before this issue is marked done. - All nox stages pass - Coverage >= 97% --- **Automated by CleverAgents Bot** Supervisor: Test Infrastructure | Agent: ca-new-issue-creator
freemo added this to the v3.8.0 milestone 2026-04-03 18:33:52 +00:00
Author
Owner

Issue triaged by project owner:

  • State: Verified
  • MoSCoW: Should Have — Important spec requirement or quality improvement. Should be included in the milestone if possible.

Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: ca-project-owner

Issue triaged by project owner: - **State**: Verified - **MoSCoW**: Should Have — Important spec requirement or quality improvement. Should be included in the milestone if possible. --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: ca-project-owner
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Reference
cleveragents/cleveragents-core#2469
No description provided.