cleveragents/cleveragents-core

Fork 3

chore(ci): capture nox output as CI artifacts and teach agents to read them #2782

Merged

freemo merged 1 commit from chore/m5-ci-nox-log-artifacts into master

2026-04-04 19:58:50 +00:00

freemo commented

2026-04-04 19:26:36 +00:00

Owner

Summary

This PR instruments all 8 nox-running CI jobs in .forgejo/workflows/ci.yml to capture their stdout+stderr output as named Forgejo artifacts, and updates 7 agent definition files to consume those artifacts when diagnosing and fixing CI failures. This gives agents (and human reviewers) immediate access to structured, downloadable CI logs without having to scrape the Forgejo UI.

Changes

CI Workflow (`.forgejo/workflows/ci.yml`)

Log capture via tee: All 8 nox-running jobs (lint, typecheck, security, quality, unit_tests, integration_tests, e2e_tests, coverage) now pipe their nox invocation through 2>&1 | tee build/nox-<job>-output.log, so output is simultaneously visible in the live CI job log and written to a file.
Artifact upload with if: always(): Each job gains an upload step that publishes its log file as a named artifact even when the job fails — which is precisely when the log is most needed. Artifact names follow the convention ci-logs-<job> (e.g., ci-logs-lint, ci-logs-unit-tests).
Multi-session jobs use tee -a: Jobs that run more than one nox session (lint runs lint + format; security runs security_scan + dead_code) append to a single combined log file using tee -a, keeping one artifact per CI job rather than one per nox session.
30-day retention: All new artifacts are retained for 30 days, consistent with the existing coverage-reports artifact policy.
Existing coverage-reports artifact preserved: The coverage job now produces two artifacts — the existing coverage-reports (HTML/XML reports) and the new ci-logs-coverage (raw nox output) — with no disruption to downstream consumers of coverage data.

Agent Definition Files (`.opencode/agents/`)

Seven agent definition files received a new CI Log Artifacts section documenting the artifact name they should download, the curl command to fetch it from the Forgejo API, and the instruction to read the artifact content first before falling back to running nox locally:

Agent file	Artifact consumed
`ca-pr-checker.md`	All 8 artifacts (artifact table + Step 2 updated to download before dispatching fix subagents)
`ca-lint-fixer.md`	`ci-logs-lint`
`ca-typecheck-fixer.md`	`ci-logs-typecheck`
`ca-unit-test-runner.md`	`ci-logs-unit-tests`
`ca-integration-test-runner.md`	`ci-logs-integration-tests`
`ca-coverage-checker.md`	`ci-logs-coverage`
`ca-pr-self-reviewer.md`	All 8 artifacts (for holistic review context)

The canonical instruction added to each agent is: "If artifact content is provided, read it first; otherwise run nox locally." This ensures agents degrade gracefully when artifacts are unavailable (e.g., on a first-run PR with no prior CI execution).

Design Decisions

tee over redirect (>): Using tee preserves the live streaming output in the Forgejo CI job log, which is essential for real-time monitoring. A plain redirect would silence the terminal output and make live debugging impossible.
if: always() on upload steps: Artifacts are most valuable when a job has failed. Omitting if: always() would mean the log is never uploaded for the exact runs where it is needed most.
tee -a for multi-session jobs: Appending to a single file per CI job (rather than one file per nox session) keeps the artifact namespace clean and avoids agents having to download multiple files for a single job's diagnosis.
Separate artifact per job (not one monolithic archive): Named per-job artifacts allow agents to download only the log relevant to the failure they are fixing, reducing token consumption and latency.
Agent fallback to local nox: Agents are instructed to run nox locally if no artifact is provided. This keeps agent definitions functional in local development workflows and on PRs that have not yet triggered CI.
No Python source changes: This PR is purely CI infrastructure and documentation. No production code, no test code, and no noxfile.py changes were required, so coverage and unit-test regressions are not a concern.

Testing

Unit tests (Behave): N/A — no Python source or BDD feature files were modified
Integration tests (Robot): N/A — no Python source or Robot test files were modified
Coverage: Unaffected — no source changes
Benchmarks: Not needed
Local quality gates verified: nox -s lint ✓, nox -s typecheck ✓, nox -s security_scan ✓

Modules Affected

.forgejo/workflows/ci.yml — CI pipeline definition (all 8 nox job steps + 8 new artifact upload steps)
.opencode/agents/ca-pr-checker.md — PR checker agent definition
.opencode/agents/ca-lint-fixer.md — Lint fixer agent definition
.opencode/agents/ca-typecheck-fixer.md — Type-check fixer agent definition
.opencode/agents/ca-unit-test-runner.md — Unit test runner agent definition
.opencode/agents/ca-integration-test-runner.md — Integration test runner agent definition
.opencode/agents/ca-coverage-checker.md — Coverage checker agent definition
.opencode/agents/ca-pr-self-reviewer.md — PR self-reviewer agent definition

Closes #2750

Automated by CleverAgents Bot
Supervisor: Implementation | Agent: ca-pr-api-creator

## Summary This PR instruments all 8 nox-running CI jobs in `.forgejo/workflows/ci.yml` to capture their stdout+stderr output as named Forgejo artifacts, and updates 7 agent definition files to consume those artifacts when diagnosing and fixing CI failures. This gives agents (and human reviewers) immediate access to structured, downloadable CI logs without having to scrape the Forgejo UI. ## Changes ### CI Workflow (`.forgejo/workflows/ci.yml`) - **Log capture via `tee`:** All 8 nox-running jobs (`lint`, `typecheck`, `security`, `quality`, `unit_tests`, `integration_tests`, `e2e_tests`, `coverage`) now pipe their nox invocation through `2>&1 | tee build/nox-<job>-output.log`, so output is simultaneously visible in the live CI job log and written to a file. - **Artifact upload with `if: always()`:** Each job gains an upload step that publishes its log file as a named artifact even when the job fails — which is precisely when the log is most needed. Artifact names follow the convention `ci-logs-<job>` (e.g., `ci-logs-lint`, `ci-logs-unit-tests`). - **Multi-session jobs use `tee -a`:** Jobs that run more than one nox session (lint runs `lint` + `format`; security runs `security_scan` + `dead_code`) append to a single combined log file using `tee -a`, keeping one artifact per CI job rather than one per nox session. - **30-day retention:** All new artifacts are retained for 30 days, consistent with the existing `coverage-reports` artifact policy. - **Existing `coverage-reports` artifact preserved:** The `coverage` job now produces two artifacts — the existing `coverage-reports` (HTML/XML reports) and the new `ci-logs-coverage` (raw nox output) — with no disruption to downstream consumers of coverage data. ### Agent Definition Files (`.opencode/agents/`) Seven agent definition files received a new **CI Log Artifacts** section documenting the artifact name they should download, the curl command to fetch it from the Forgejo API, and the instruction to read the artifact content first before falling back to running nox locally: | Agent file | Artifact consumed | |---|---| | `ca-pr-checker.md` | All 8 artifacts (artifact table + Step 2 updated to download before dispatching fix subagents) | | `ca-lint-fixer.md` | `ci-logs-lint` | | `ca-typecheck-fixer.md` | `ci-logs-typecheck` | | `ca-unit-test-runner.md` | `ci-logs-unit-tests` | | `ca-integration-test-runner.md` | `ci-logs-integration-tests` | | `ca-coverage-checker.md` | `ci-logs-coverage` | | `ca-pr-self-reviewer.md` | All 8 artifacts (for holistic review context) | The canonical instruction added to each agent is: *"If artifact content is provided, read it first; otherwise run nox locally."* This ensures agents degrade gracefully when artifacts are unavailable (e.g., on a first-run PR with no prior CI execution). ## Design Decisions - **`tee` over redirect (`>`):** Using `tee` preserves the live streaming output in the Forgejo CI job log, which is essential for real-time monitoring. A plain redirect would silence the terminal output and make live debugging impossible. - **`if: always()` on upload steps:** Artifacts are most valuable when a job has failed. Omitting `if: always()` would mean the log is never uploaded for the exact runs where it is needed most. - **`tee -a` for multi-session jobs:** Appending to a single file per CI job (rather than one file per nox session) keeps the artifact namespace clean and avoids agents having to download multiple files for a single job's diagnosis. - **Separate artifact per job (not one monolithic archive):** Named per-job artifacts allow agents to download only the log relevant to the failure they are fixing, reducing token consumption and latency. - **Agent fallback to local nox:** Agents are instructed to run nox locally if no artifact is provided. This keeps agent definitions functional in local development workflows and on PRs that have not yet triggered CI. - **No Python source changes:** This PR is purely CI infrastructure and documentation. No production code, no test code, and no `noxfile.py` changes were required, so coverage and unit-test regressions are not a concern. ## Testing - Unit tests (Behave): N/A — no Python source or BDD feature files were modified - Integration tests (Robot): N/A — no Python source or Robot test files were modified - Coverage: Unaffected — no source changes - Benchmarks: Not needed - Local quality gates verified: `nox -s lint` ✓, `nox -s typecheck` ✓, `nox -s security_scan` ✓ ## Modules Affected - `.forgejo/workflows/ci.yml` — CI pipeline definition (all 8 nox job steps + 8 new artifact upload steps) - `.opencode/agents/ca-pr-checker.md` — PR checker agent definition - `.opencode/agents/ca-lint-fixer.md` — Lint fixer agent definition - `.opencode/agents/ca-typecheck-fixer.md` — Type-check fixer agent definition - `.opencode/agents/ca-unit-test-runner.md` — Unit test runner agent definition - `.opencode/agents/ca-integration-test-runner.md` — Integration test runner agent definition - `.opencode/agents/ca-coverage-checker.md` — Coverage checker agent definition - `.opencode/agents/ca-pr-self-reviewer.md` — PR self-reviewer agent definition Closes #2750 --- **Automated by CleverAgents Bot** Supervisor: Implementation | Agent: ca-pr-api-creator

freemo added 1 commit

2026-04-04 19:26:36 +00:00

chore(ci): capture nox output as CI artifacts and teach agents to read them

CI / lint (pull_request) Successful in 27s

Details

CI / security (pull_request) Successful in 1m6s

Details

CI / typecheck (pull_request) Successful in 4m5s

Details

CI / quality (pull_request) Successful in 3m59s

Details

CI / build (pull_request) Successful in 24s

Details

CI / helm (pull_request) Successful in 23s

Details

CI / unit_tests (pull_request) Failing after 6m45s

Details

CI / docker (pull_request) Has been skipped

Details

CI / e2e_tests (pull_request) Failing after 14m42s

Details

CI / coverage (pull_request) Successful in 14m36s

Details

CI / integration_tests (pull_request) Failing after 22m10s

Details

CI / status-check (pull_request) Failing after 2s

Details

CI / benchmark-publish (pull_request) Has been skipped

Details

CI / benchmark-regression (pull_request) Successful in 55m48s

Details

8c8de7b286

All 8 nox-running CI jobs in .forgejo/workflows/ci.yml now capture
stdout+stderr to build/nox-<job>-output.log via `2>&1 | tee` and upload
the log as a named Forgejo artifact (if: always(), retention-days: 30).
Artifact names follow the pattern ci-logs-<job>:
  ci-logs-lint, ci-logs-typecheck, ci-logs-security, ci-logs-quality,
  ci-logs-unit-tests, ci-logs-integration-tests, ci-logs-e2e-tests,
  ci-logs-coverage

Seven agent definitions updated with a CI Log Artifacts section:
  ca-pr-checker.md: artifact table + curl download instructions; Step 2
    now downloads the relevant artifact before dispatching fix subagents.
  ca-lint-fixer.md, ca-typecheck-fixer.md, ca-unit-test-runner.md,
  ca-integration-test-runner.md, ca-coverage-checker.md,
  ca-pr-self-reviewer.md: each receives a section explaining which
    artifact corresponds to its domain and how to use it.

Design notes:
- tee (not redirect) preserves output in CI job logs AND captures to file
- if: always() ensures artifacts are available even when the job fails
- Multi-session jobs (lint, security) use tee -a to append to one file
- Existing coverage-reports artifact preserved alongside ci-logs-coverage

ISSUES CLOSED: #2750

freemo added the

Type

Task

label

2026-04-04 19:26:46 +00:00

freemo added this to the v3.2.0 milestone

2026-04-04 19:26:59 +00:00

freemo added a new dependency

2026-04-04 19:27:06 +00:00

#2750 chore(ci): capture nox output as CI artifacts and update agent definitions to consume them

Job	Status	Description
`CI / lint`	⏳ pending	Waiting to run
`CI / typecheck`	⏳ pending	Waiting to run
`CI / security`	⏳ pending	Waiting to run
`CI / quality`	⏳ pending	Waiting to run
`CI / unit_tests`	⏳ pending	Waiting to run
`CI / integration_tests`	⏳ pending	Waiting to run
`CI / e2e_tests`	⏳ pending	Waiting to run
`CI / coverage`	⏳ pending	Blocked by required conditions
`CI / benchmark-regression`	⏳ pending	Blocked by required conditions
`CI / benchmark-publish`	⏳ pending	Waiting to run
`CI / build`	⏳ pending	Waiting to run
`CI / docker`	⏳ pending	Blocked by required conditions
`CI / helm`	⏳ pending	Waiting to run
`CI / status-check`	⏳ pending	Blocked by required conditions

Rows
Columns

chore(ci): capture nox output as CI artifacts and teach agents to read them #2782

Summary

Changes

CI Workflow (.forgejo/workflows/ci.yml)

Agent Definition Files (.opencode/agents/)

Design Decisions

Testing

Modules Affected

CI Status Snapshot (as of check time)

PR Metadata Review ✅

Notes

Code Review — APPROVED ✅

Review Summary

Criteria Evaluated

✅ Specification Alignment

✅ PR Metadata & Commit Standards

✅ CI Workflow Changes (.forgejo/workflows/ci.yml)

✅ Agent Documentation Changes

✅ Security

✅ Correctness

No Issues Found

CI Workflow (`.forgejo/workflows/ci.yml`)

Agent Definition Files (`.opencode/agents/`)

✅ CI Workflow Changes (`.forgejo/workflows/ci.yml`)