TEST-INFRA: [ci-pipeline-design] Use matrix strategy for tests #1676

New issue

Closed

opened 2026-04-02 23:27:55 +00:00 by freemo · 2 comments

freemo commented

2026-04-02 23:27:55 +00:00

Owner

Metadata

Branch: task/v3.8.0-ci-matrix-strategy-tests
Commit Message: chore(ci): use matrix strategy for parallel multi-python-version test execution
Milestone: v3.8.0
Parent Epic: (to be linked — see orphan note below)

Background and Context

The noxfile.py defines separate sessions for different Python versions. While this is a good practice, it could be improved by using a matrix strategy in the CI configuration. This would allow running the tests in parallel for all supported Python versions, which would reduce the overall CI execution time.

Area: CI/CD

Subtasks

Modify .forgejo/workflows/ci.yml to use a matrix strategy (e.g., strategy.matrix.python-version) for the test sessions covering all supported Python versions
Ensure each matrix job invokes the correct nox session for its Python version (e.g., nox -e unit_tests-3.11, nox -e unit_tests-3.12)
Verify that the tests are running in parallel for all supported Python versions in CI
Confirm overall CI execution time is reduced compared to the sequential baseline
Run nox (all default sessions), fix any errors
Verify coverage >= 97% via nox -s coverage_report

Definition of Done

This issue is complete when:

All subtasks above are completed and checked off.
A Git commit is created where the first line of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details about the implementation.
The commit is pushed to the remote on the branch matching the Branch in Metadata exactly.
The commit is submitted as a pull request to master, reviewed, and merged before this issue is marked done.
All nox stages pass.
Coverage >= 97%.

⚠️ Orphan Notice: No parent Epic was provided at issue creation time. This issue must be manually linked to the appropriate TEST-INFRA: [ci-pipeline-design] Epic before work begins. Orphan issues are not permitted per CONTRIBUTING.md.

Automated by CleverAgents Bot
Supervisor: Test Infrastructure | Agent: ca-new-issue-creator

## Metadata - **Branch**: `task/v3.8.0-ci-matrix-strategy-tests` - **Commit Message**: `chore(ci): use matrix strategy for parallel multi-python-version test execution` - **Milestone**: v3.8.0 - **Parent Epic**: *(to be linked — see orphan note below)* ## Background and Context The `noxfile.py` defines separate sessions for different Python versions. While this is a good practice, it could be improved by using a matrix strategy in the CI configuration. This would allow running the tests in parallel for all supported Python versions, which would reduce the overall CI execution time. **Area**: CI/CD ## Subtasks - [ ] Modify `.forgejo/workflows/ci.yml` to use a matrix strategy (e.g., `strategy.matrix.python-version`) for the test sessions covering all supported Python versions - [ ] Ensure each matrix job invokes the correct `nox` session for its Python version (e.g., `nox -e unit_tests-3.11`, `nox -e unit_tests-3.12`) - [ ] Verify that the tests are running in parallel for all supported Python versions in CI - [ ] Confirm overall CI execution time is reduced compared to the sequential baseline - [ ] Run `nox` (all default sessions), fix any errors - [ ] Verify coverage >= 97% via `nox -s coverage_report` ## Definition of Done This issue is complete when: - All subtasks above are completed and checked off. - A Git commit is created where the **first line** of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details about the implementation. - The commit is pushed to the remote on the branch matching the **Branch** in Metadata exactly. - The commit is submitted as a **pull request** to `master`, reviewed, and **merged** before this issue is marked done. - All nox stages pass. - Coverage >= 97%. --- > ⚠️ **Orphan Notice**: No parent Epic was provided at issue creation time. This issue must be manually linked to the appropriate `TEST-INFRA: [ci-pipeline-design]` Epic before work begins. Orphan issues are not permitted per CONTRIBUTING.md. --- **Automated by CleverAgents Bot** Supervisor: Test Infrastructure | Agent: ca-new-issue-creator

freemo added this to the v3.8.0 milestone

2026-04-02 23:30:13 +00:00

freemo commented

2026-04-02 23:31:36 +00:00

Author

Owner

⚠️ Orphan Issue — Manual Linking Required

This issue was created without a parent Epic because no open Type/Epic issue for the TEST-INFRA: [ci-pipeline-design] workstream currently exists in the repository.

Per CONTRIBUTING.md, orphan issues are not permitted. Before work begins on this issue, a maintainer must either:

Create a TEST-INFRA: [ci-pipeline-design] Epic and link this issue as a child (this issue should block the parent Epic), or
Link this issue to an existing Epic if one is created in the interim.

The correct dependency direction is:

This issue (#1676) BLOCKS the parent Epic — meaning the Epic cannot be closed until this issue is resolved.

To create the dependency once an Epic exists, use:

curl -s -X POST "https://git.cleverthis.com/api/v1/repos/cleveragents/cleveragents-core/issues/1676/blocks" \
  -H "Authorization: token <PAT>" \
  -H "Content-Type: application/json" \
  -d '{"dependency_id": <PARENT_EPIC_NUMBER>}'

Automated by CleverAgents Bot
Supervisor: Test Infrastructure | Agent: ca-new-issue-creator

⚠️ **Orphan Issue — Manual Linking Required** This issue was created without a parent Epic because no open `Type/Epic` issue for the `TEST-INFRA: [ci-pipeline-design]` workstream currently exists in the repository. Per `CONTRIBUTING.md`, orphan issues are **not permitted**. Before work begins on this issue, a maintainer must either: 1. **Create a `TEST-INFRA: [ci-pipeline-design]` Epic** and link this issue as a child (this issue should **block** the parent Epic), or 2. **Link this issue to an existing Epic** if one is created in the interim. The correct dependency direction is: > **This issue (#1676) BLOCKS the parent Epic** — meaning the Epic cannot be closed until this issue is resolved. To create the dependency once an Epic exists, use: ```bash curl -s -X POST "https://git.cleverthis.com/api/v1/repos/cleveragents/cleveragents-core/issues/1676/blocks" \ -H "Authorization: token <PAT>" \ -H "Content-Type: application/json" \ -d '{"dependency_id": <PARENT_EPIC_NUMBER>}' ``` --- **Automated by CleverAgents Bot** Supervisor: Test Infrastructure | Agent: ca-new-issue-creator

freemo referenced this issue

2026-04-02 23:42:25 +00:00

TEST-INFRA: [ci-pipeline-design] Implement matrix testing strategy for different Python versions #1744

freemo referenced this issue

2026-04-02 23:52:50 +00:00

Proposal: improve ca-test-infra-improver — prevent massive duplicate issue creation #1802

freemo referenced this issue

2026-04-05 06:50:14 +00:00

chore(agents): improve ca-test-infra-improver — prevent massive duplicate issue creation #3142

freemo commented

2026-04-05 09:59:15 +00:00

Author

Owner

Closing as duplicate of #1672 (TEST-INFRA: Introduce a matrix testing strategy for multiple Python versions).

Both issues describe the same work: introducing a CI matrix strategy for multi-Python-version testing. #1672 was created first and has the same scope.

Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: ca-project-owner

Closing as duplicate of #1672 (TEST-INFRA: Introduce a matrix testing strategy for multiple Python versions). Both issues describe the same work: introducing a CI matrix strategy for multi-Python-version testing. #1672 was created first and has the same scope. --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: ca-project-owner

freemo

2026-04-05 09:59:38 +00:00