TEST-INFRA: [missing-test-levels] Add Robot and ASV tests for plan_generation.py #3384

New issue

Open

opened 2026-04-05 15:20:20 +00:00 by freemo · 2 comments

freemo commented

2026-04-05 15:20:20 +00:00

Owner

Metadata

Branch: test/plan-generation-robot-asv
Commit Message: test(plan_generation): add Robot integration and ASV benchmark tests
Milestone: (none — backlog)
Parent Epic: (see orphan note below)

Context

The module src/cleveragents/agents/plan_generation.py is missing the following test levels:

Robot (integration tests) — validates the plan generation lifecycle (Strategize → Execute → Apply phases) end-to-end via Robot Framework
ASV (performance benchmarks) — tracks throughput and latency of plan generation under load via Airspeed Velocity

Subtasks

Create robot/plan_generation.robot with integration tests covering the plan generation lifecycle
Create benchmarks/plan_generation_bench.py with ASV performance benchmarks for the module
Verify all new Robot tests pass in CI (nox -s robot or equivalent)
Verify all new ASV benchmarks run without error (asv run or equivalent)
Run nox (all default sessions), fix any errors
Verify coverage >= 97% via nox -s coverage_report

Definition of Done

All subtasks above are completed and checked off
robot/plan_generation.robot exists and all scenarios pass in CI
benchmarks/plan_generation_bench.py exists and all benchmarks execute without error
A Git commit is created where the first line of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details about the implementation
The commit is pushed to the remote on the branch matching the Branch in Metadata exactly
The commit is submitted as a pull request to master, reviewed, and merged before this issue is marked done
All nox stages pass
Coverage >= 97%

Backlog note: This issue was discovered during autonomous operation
on milestone . It does not block milestone completion and has been
placed in the backlog for human review and future milestone assignment.

Automated by CleverAgents Bot
Supervisor: Test Infrastructure | Agent: ca-new-issue-creator

## Metadata - **Branch**: `test/plan-generation-robot-asv` - **Commit Message**: `test(plan_generation): add Robot integration and ASV benchmark tests` - **Milestone**: *(none — backlog)* - **Parent Epic**: *(see orphan note below)* ## Context The module `src/cleveragents/agents/plan_generation.py` is missing the following test levels: - **Robot** (integration tests) — validates the plan generation lifecycle (Strategize → Execute → Apply phases) end-to-end via Robot Framework - **ASV** (performance benchmarks) — tracks throughput and latency of plan generation under load via Airspeed Velocity ## Subtasks - [ ] Create `robot/plan_generation.robot` with integration tests covering the plan generation lifecycle - [ ] Create `benchmarks/plan_generation_bench.py` with ASV performance benchmarks for the module - [ ] Verify all new Robot tests pass in CI (`nox -s robot` or equivalent) - [ ] Verify all new ASV benchmarks run without error (`asv run` or equivalent) - [ ] Run `nox` (all default sessions), fix any errors - [ ] Verify coverage >= 97% via `nox -s coverage_report` ## Definition of Done - [ ] All subtasks above are completed and checked off - [ ] `robot/plan_generation.robot` exists and all scenarios pass in CI - [ ] `benchmarks/plan_generation_bench.py` exists and all benchmarks execute without error - [ ] A Git commit is created where the **first line** of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details about the implementation - [ ] The commit is pushed to the remote on the branch matching the **Branch** in Metadata exactly - [ ] The commit is submitted as a **pull request** to `master`, reviewed, and **merged** before this issue is marked done - [ ] All nox stages pass - [ ] Coverage >= 97% --- > **Backlog note:** This issue was discovered during autonomous operation > on milestone <M>. It does not block milestone completion and has been > placed in the backlog for human review and future milestone assignment. --- **Automated by CleverAgents Bot** Supervisor: Test Infrastructure | Agent: ca-new-issue-creator

freemo commented

2026-04-05 15:20:40 +00:00

Author

Owner

⚠️ Orphan Issue — Manual Linking Required

This issue was created without an explicit parent Epic. No open Epic was found that clearly covers test-level additions (Robot integration tests + ASV benchmarks) for plan_generation.py.

Suggested candidates for parent Epic:

#3374 — Epic: E2E Workflow Specification Tests & Code Review Tool Examples (closest match for test additions)
#2810 — Epic: CI Quality Gates Restoration (relevant if this is tied to CI quality)

A project owner should manually link this issue to the appropriate parent Epic by setting this issue to block the parent Epic (child blocks parent — per CONTRIBUTING.md dependency direction rules).

# Example: link this issue (#3384) as blocking parent Epic #XXXX
curl -s -X POST "https://git.cleverthis.com/api/v1/repos/cleveragents/cleveragents-core/issues/3384/blocks" \
  -H "Authorization: token <PAT>" \
  -H "Content-Type: application/json" \
  -d '{"owner": "cleveragents", "repo": "cleveragents-core", "index": <PARENT_EPIC_NUMBER>}'

Automated by CleverAgents Bot
Supervisor: Test Infrastructure | Agent: ca-new-issue-creator

⚠️ **Orphan Issue — Manual Linking Required** This issue was created without an explicit parent Epic. No open Epic was found that clearly covers test-level additions (Robot integration tests + ASV benchmarks) for `plan_generation.py`. **Suggested candidates for parent Epic:** - `#3374` — Epic: E2E Workflow Specification Tests & Code Review Tool Examples *(closest match for test additions)* - `#2810` — Epic: CI Quality Gates Restoration *(relevant if this is tied to CI quality)* A project owner should manually link this issue to the appropriate parent Epic by setting this issue to **block** the parent Epic (child blocks parent — per CONTRIBUTING.md dependency direction rules). ```bash # Example: link this issue (#3384) as blocking parent Epic #XXXX curl -s -X POST "https://git.cleverthis.com/api/v1/repos/cleveragents/cleveragents-core/issues/3384/blocks" \ -H "Authorization: token <PAT>" \ -H "Content-Type: application/json" \ -d '{"owner": "cleveragents", "repo": "cleveragents-core", "index": <PARENT_EPIC_NUMBER>}' ``` --- **Automated by CleverAgents Bot** Supervisor: Test Infrastructure | Agent: ca-new-issue-creator

freemo commented

2026-04-05 16:26:23 +00:00

Author

Owner

Issue triaged by project owner:

State: Verified
Priority: Backlog (unchanged)
Story Points: 3 — M
MoSCoW: Could Have — Supplementary test levels for plan_generation.py.
Parent Epic: #2810

Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: ca-project-owner

Issue triaged by project owner: - **State**: Verified - **Priority**: Backlog (unchanged) - **Story Points**: 3 — M - **MoSCoW**: Could Have — Supplementary test levels for plan_generation.py. - **Parent Epic**: #2810 --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: ca-project-owner