TEST-INFRA: [ci-execution-time] Parallelize e2e_tests #1786

Open
opened 2026-04-02 23:49:30 +00:00 by freemo · 0 comments
Owner

Metadata

  • Branch: test/parallelize-e2e-tests
  • Commit Message: test(ci): parallelize e2e_tests nox session using pabot
  • Milestone: v3.8.0
  • Parent Epic: #1678

Description

The e2e_tests nox session currently runs Robot Framework tests sequentially. These tests are the longest-running tests in the suite and would benefit the most from parallel execution.

Affected Area: test-infra / noxfile.py

Task

Modify the e2e_tests nox session in noxfile.py to run the tests in parallel using pabot. The session should use the same parallel execution logic as the integration_tests session.

Subtasks

  • Audit the current e2e_tests nox session in noxfile.py to understand its structure and dependencies.
  • Update the e2e_tests session to invoke pabot instead of robot for parallel test execution, mirroring the integration_tests session pattern.
  • Verify that all existing e2e Robot Framework tests pass correctly under pabot.
  • Measure and document the CI execution time before and after the change to confirm the performance improvement.
  • Update any relevant CI workflow steps or documentation that reference the e2e_tests session.

Definition of Done

  • The e2e_tests nox session is updated to use pabot for parallel test execution.
  • The CI execution time for the e2e_tests session is measured and documented to show the performance improvement.
  • All existing e2e tests pass without regression under the parallelized session.
  • All nox stages pass
  • Coverage >= 97%

Automated by CleverAgents Bot
Supervisor: Test Infrastructure | Agent: ca-new-issue-creator

## Metadata - **Branch**: `test/parallelize-e2e-tests` - **Commit Message**: `test(ci): parallelize e2e_tests nox session using pabot` - **Milestone**: `v3.8.0` - **Parent Epic**: #1678 ## Description The `e2e_tests` nox session currently runs Robot Framework tests sequentially. These tests are the longest-running tests in the suite and would benefit the most from parallel execution. **Affected Area**: `test-infra` / `noxfile.py` ## Task Modify the `e2e_tests` nox session in `noxfile.py` to run the tests in parallel using `pabot`. The session should use the same parallel execution logic as the `integration_tests` session. ## Subtasks - [ ] Audit the current `e2e_tests` nox session in `noxfile.py` to understand its structure and dependencies. - [ ] Update the `e2e_tests` session to invoke `pabot` instead of `robot` for parallel test execution, mirroring the `integration_tests` session pattern. - [ ] Verify that all existing e2e Robot Framework tests pass correctly under `pabot`. - [ ] Measure and document the CI execution time before and after the change to confirm the performance improvement. - [ ] Update any relevant CI workflow steps or documentation that reference the `e2e_tests` session. ## Definition of Done - [ ] The `e2e_tests` nox session is updated to use `pabot` for parallel test execution. - [ ] The CI execution time for the `e2e_tests` session is measured and documented to show the performance improvement. - [ ] All existing e2e tests pass without regression under the parallelized session. - [ ] All nox stages pass - [ ] Coverage >= 97% --- **Automated by CleverAgents Bot** Supervisor: Test Infrastructure | Agent: ca-new-issue-creator
freemo added this to the v3.8.0 milestone 2026-04-02 23:50:02 +00:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Reference
cleveragents/cleveragents-core#1786
No description provided.