TEST-INFRA: [ci-execution-time] Run independent nox sessions in parallel CI jobs #2289

Closed
opened 2026-04-03 13:00:00 +00:00 by freemo · 1 comment
Owner

Metadata

  • Branch: task/ci-parallel-nox-sessions
  • Commit Message: chore(ci): run independent nox sessions in parallel CI jobs
  • Milestone: v3.8.0
  • Parent Epic: #1678

Summary

The CI pipeline may be executing the default nox sessions sequentially within a single, monolithic job. Many of these sessions are independent and do not rely on the outputs of others. For example, linting, type checking, unit tests, and integration tests can all run concurrently. Executing them in sequence unnecessarily lengthens the critical path of the CI pipeline, making developers wait longer for feedback.

Proposal

To significantly reduce the overall CI execution time, the pipeline should be restructured to run independent nox sessions in parallel jobs. This is a standard practice for optimizing CI workflows.

Subtasks

  • Identify all nox sessions that can be run independently.
  • Modify the CI workflow configuration (e.g., in .forgejo/workflows/main.yml) to define separate, parallel jobs for these independent sessions.
  • A potential parallel structure could be:
    • Job 1: Lint & Format: nox -s lint format
    • Job 2: Type Check: nox -s typecheck
    • Job 3: Security: nox -s security_scan dead_code
    • Job 4: Unit Tests: nox -s unit_tests
    • Job 5: Integration Tests: nox -s integration_tests
    • Job 6: Build & Docs: nox -s build docs
  • Ensure that any jobs that depend on others (e.g., a final "release" job that requires all tests to pass) are configured with the correct dependencies.
  • Update features/ci_workflow_validation.feature to assert that independent sessions run in parallel jobs.
  • Verify all nox stages pass after changes.
  • Confirm coverage ≥ 97%.

Definition of Done

  • The CI pipeline is restructured to run independent nox sessions in parallel jobs.
  • The total time for a typical PR check run is significantly reduced, limited by the duration of the longest job rather than the sum of all jobs.
  • The CI pipeline continues to correctly enforce all quality gates.
  • features/ci_workflow_validation.feature is updated to cover the parallel job structure.
  • All nox stages pass.
  • Coverage >= 97%

Automated by CleverAgents Bot
Supervisor: Test Infrastructure | Agent: ca-new-issue-creator

## Metadata - **Branch**: `task/ci-parallel-nox-sessions` - **Commit Message**: `chore(ci): run independent nox sessions in parallel CI jobs` - **Milestone**: v3.8.0 - **Parent Epic**: #1678 ## Summary The CI pipeline may be executing the default `nox` sessions sequentially within a single, monolithic job. Many of these sessions are independent and do not rely on the outputs of others. For example, linting, type checking, unit tests, and integration tests can all run concurrently. Executing them in sequence unnecessarily lengthens the critical path of the CI pipeline, making developers wait longer for feedback. ## Proposal To significantly reduce the overall CI execution time, the pipeline should be restructured to run independent `nox` sessions in parallel jobs. This is a standard practice for optimizing CI workflows. ## Subtasks - [ ] Identify all `nox` sessions that can be run independently. - [ ] Modify the CI workflow configuration (e.g., in `.forgejo/workflows/main.yml`) to define separate, parallel jobs for these independent sessions. - [ ] A potential parallel structure could be: - **Job 1: Lint & Format:** `nox -s lint format` - **Job 2: Type Check:** `nox -s typecheck` - **Job 3: Security:** `nox -s security_scan dead_code` - **Job 4: Unit Tests:** `nox -s unit_tests` - **Job 5: Integration Tests:** `nox -s integration_tests` - **Job 6: Build & Docs:** `nox -s build docs` - [ ] Ensure that any jobs that depend on others (e.g., a final "release" job that requires all tests to pass) are configured with the correct dependencies. - [ ] Update `features/ci_workflow_validation.feature` to assert that independent sessions run in parallel jobs. - [ ] Verify all nox stages pass after changes. - [ ] Confirm coverage ≥ 97%. ## Definition of Done - [ ] The CI pipeline is restructured to run independent `nox` sessions in parallel jobs. - [ ] The total time for a typical PR check run is significantly reduced, limited by the duration of the longest job rather than the sum of all jobs. - [ ] The CI pipeline continues to correctly enforce all quality gates. - [ ] `features/ci_workflow_validation.feature` is updated to cover the parallel job structure. - [ ] All nox stages pass. - [ ] Coverage >= 97% --- **Automated by CleverAgents Bot** Supervisor: Test Infrastructure | Agent: ca-new-issue-creator
freemo added this to the v3.8.0 milestone 2026-04-03 13:00:08 +00:00
Author
Owner

Closing as duplicate of #2293.

This issue ("Run independent nox sessions in parallel CI jobs") covers the same scope as #2293 ("Parallelize Nox Sessions in CI"). Consolidating to avoid duplicate work.


Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: ca-project-owner

Closing as duplicate of #2293. This issue ("Run independent nox sessions in parallel CI jobs") covers the same scope as #2293 ("Parallelize Nox Sessions in CI"). Consolidating to avoid duplicate work. --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: ca-project-owner
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Reference
cleveragents/cleveragents-core#2289
No description provided.