TEST-INFRA: [ci-execution-time] Split large test suites to run in parallel across multiple jobs #2288

Closed
opened 2026-04-03 12:58:59 +00:00 by freemo · 1 comment
Owner

Metadata

  • Branch: chore/ci-split-e2e-tests-parallel
  • Commit Message: perf(ci): split e2e test suite into parallel jobs to reduce execution time
  • Milestone: v3.8.0
  • Parent Epic: #1678

Summary

Currently, the e2e_tests job runs all E2E tests in a single job. As the number of E2E tests grows, this job will become slower and more prone to timeouts.

To improve this, we can split the E2E test suite into smaller, more focused test suites that can be run in parallel across multiple CI jobs.

Subtasks

  • Investigate the E2E test suite to identify logical groups of tests that can be run independently.
  • Modify the .forgejo/workflows/ci.yml file to create multiple e2e_tests jobs, each running a subset of the tests.
  • Modify the noxfile.py to support running subsets of the E2E tests.
  • Update features/ci_workflow_validation.feature to assert the new parallel E2E job structure is present.
  • Run nox (all default sessions), fix any errors.
  • Verify coverage >= 97% via nox -s coverage_report.

Definition of Done

  • The E2E test suite is split into smaller, independent suites.
  • The CI pipeline runs these suites in parallel across multiple jobs.
  • The overall E2E test execution time is reduced.
  • All nox stages pass.
  • Coverage >= 97%.
  • A Git commit is created where the first line of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details about the implementation.
  • The commit is pushed to the remote on the branch matching the Branch in Metadata exactly.
  • The commit is submitted as a pull request to master, reviewed, and merged before this issue is marked done.

Automated by CleverAgents Bot
Supervisor: Test Infrastructure | Agent: ca-new-issue-creator

## Metadata - **Branch**: `chore/ci-split-e2e-tests-parallel` - **Commit Message**: `perf(ci): split e2e test suite into parallel jobs to reduce execution time` - **Milestone**: v3.8.0 - **Parent Epic**: #1678 ## Summary Currently, the `e2e_tests` job runs all E2E tests in a single job. As the number of E2E tests grows, this job will become slower and more prone to timeouts. To improve this, we can split the E2E test suite into smaller, more focused test suites that can be run in parallel across multiple CI jobs. ## Subtasks - [ ] Investigate the E2E test suite to identify logical groups of tests that can be run independently. - [ ] Modify the `.forgejo/workflows/ci.yml` file to create multiple `e2e_tests` jobs, each running a subset of the tests. - [ ] Modify the `noxfile.py` to support running subsets of the E2E tests. - [ ] Update `features/ci_workflow_validation.feature` to assert the new parallel E2E job structure is present. - [ ] Run `nox` (all default sessions), fix any errors. - [ ] Verify coverage >= 97% via `nox -s coverage_report`. ## Definition of Done - [ ] The E2E test suite is split into smaller, independent suites. - [ ] The CI pipeline runs these suites in parallel across multiple jobs. - [ ] The overall E2E test execution time is reduced. - [ ] All nox stages pass. - [ ] Coverage >= 97%. - [ ] A Git commit is created where the **first line** of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details about the implementation. - [ ] The commit is pushed to the remote on the branch matching the **Branch** in Metadata exactly. - [ ] The commit is submitted as a **pull request** to `master`, reviewed, and **merged** before this issue is marked done. --- **Automated by CleverAgents Bot** Supervisor: Test Infrastructure | Agent: ca-new-issue-creator
freemo added this to the v3.8.0 milestone 2026-04-03 12:59:20 +00:00
Author
Owner

Closing as duplicate of #2293.

This issue ("Split large test suites to run in parallel across multiple jobs") covers the same scope as #2293 ("Parallelize Nox Sessions in CI"). Consolidating to avoid duplicate work.


Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: ca-project-owner

Closing as duplicate of #2293. This issue ("Split large test suites to run in parallel across multiple jobs") covers the same scope as #2293 ("Parallelize Nox Sessions in CI"). Consolidating to avoid duplicate work. --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: ca-project-owner
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Reference
cleveragents/cleveragents-core#2288
No description provided.