TEST-INFRA: [ci-pipeline-design] Use a matrix build for Python versions #1731

Closed
opened 2026-04-02 23:37:01 +00:00 by freemo · 1 comment
Owner

Metadata

  • Branch: task/ci-matrix-build-python-versions
  • Commit Message: chore(ci): use a matrix build for Python versions
  • Milestone: v3.8.0
  • Parent Epic: #1678

Background and Context

The CI pipeline currently only tests against Python 3.13. To ensure broader compatibility across all supported Python versions, the pipeline should be updated to use a matrix build strategy. This will run the test suite in parallel across each supported Python version, catching version-specific regressions early and providing confidence that the project works correctly on all supported runtimes.

Expected Behavior

The CI pipeline runs all test jobs (unit tests, integration tests, linting, type checking) against every supported Python version using a matrix strategy, with results reported per-version.

Acceptance Criteria

  • The CI workflow uses a matrix strategy to test against all supported Python versions.
  • The noxfile.py is updated to support the matrix build (e.g., correct Python version parametrization).
  • All CI jobs that are Python-version-sensitive are included in the matrix.
  • The matrix build results are clearly reported per Python version in the CI UI.

Subtasks

  • Identify all supported Python versions for the project.
  • Update the CI workflow YAML to use a matrix strategy for Python versions.
  • Update noxfile.py to support parametrized Python version execution.
  • Verify all matrix jobs pass for each supported Python version.
  • Tests (Behave): Add/update scenarios covering nox session parametrization if applicable.
  • Tests (Robot): Add/update integration tests for CI pipeline configuration if applicable.
  • Verify coverage >=97% via nox -s coverage_report.
  • Run nox (all default sessions), fix any errors.

Definition of Done

This issue is complete when:

  • All subtasks above are completed and checked off.
  • A Git commit is created where the first line of the commit message matches the Commit Message in Metadata exactly (chore(ci): use a matrix build for Python versions), followed by a blank line, then additional lines providing relevant details about the implementation.
  • The commit is pushed to the remote on the branch matching the Branch in Metadata exactly (task/ci-matrix-build-python-versions).
  • The commit is submitted as a pull request to master, reviewed, and merged before this issue is marked done.
  • All nox stages pass.
  • Coverage >= 97%.

Automated by CleverAgents Bot
Supervisor: Test Infrastructure | Agent: ca-new-issue-creator

## Metadata - **Branch**: `task/ci-matrix-build-python-versions` - **Commit Message**: `chore(ci): use a matrix build for Python versions` - **Milestone**: v3.8.0 - **Parent Epic**: #1678 ## Background and Context The CI pipeline currently only tests against Python 3.13. To ensure broader compatibility across all supported Python versions, the pipeline should be updated to use a matrix build strategy. This will run the test suite in parallel across each supported Python version, catching version-specific regressions early and providing confidence that the project works correctly on all supported runtimes. ## Expected Behavior The CI pipeline runs all test jobs (unit tests, integration tests, linting, type checking) against every supported Python version using a matrix strategy, with results reported per-version. ## Acceptance Criteria - The CI workflow uses a matrix strategy to test against all supported Python versions. - The `noxfile.py` is updated to support the matrix build (e.g., correct Python version parametrization). - All CI jobs that are Python-version-sensitive are included in the matrix. - The matrix build results are clearly reported per Python version in the CI UI. ## Subtasks - [ ] Identify all supported Python versions for the project. - [ ] Update the CI workflow YAML to use a matrix strategy for Python versions. - [ ] Update `noxfile.py` to support parametrized Python version execution. - [ ] Verify all matrix jobs pass for each supported Python version. - [ ] Tests (Behave): Add/update scenarios covering nox session parametrization if applicable. - [ ] Tests (Robot): Add/update integration tests for CI pipeline configuration if applicable. - [ ] Verify coverage >=97% via `nox -s coverage_report`. - [ ] Run `nox` (all default sessions), fix any errors. ## Definition of Done This issue is complete when: - All subtasks above are completed and checked off. - A Git commit is created where the **first line** of the commit message matches the Commit Message in Metadata exactly (`chore(ci): use a matrix build for Python versions`), followed by a blank line, then additional lines providing relevant details about the implementation. - The commit is pushed to the remote on the branch matching the **Branch** in Metadata exactly (`task/ci-matrix-build-python-versions`). - The commit is submitted as a **pull request** to `master`, reviewed, and **merged** before this issue is marked done. - All nox stages pass. - Coverage >= 97%. --- **Automated by CleverAgents Bot** Supervisor: Test Infrastructure | Agent: ca-new-issue-creator
freemo added this to the v3.7.0 milestone 2026-04-02 23:37:39 +00:00
freemo modified the milestone from v3.7.0 to v3.8.0 2026-04-02 23:38:28 +00:00
Author
Owner

Closing as duplicate of #1539 (matrix strategy for Python versions).


Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: ca-project-owner

Closing as duplicate of #1539 (matrix strategy for Python versions). --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: ca-project-owner
freemo 2026-04-02 23:41:41 +00:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Reference
cleveragents/cleveragents-core#1731
No description provided.