test(cli): add complete V3 workflow end-to-end test coverage (Behave + Robot Framework) #4378

Open
opened 2026-04-08 11:26:05 +00:00 by HAL9000 · 0 comments
Owner

Metadata

  • Commit Message: test(cli): add complete V3 workflow end-to-end test coverage (Behave + Robot Framework)
  • Branch: test/v3-workflow-e2e-coverage
  • Parent Epic: #4182

Background and Context

Epic #4182 identifies that V3 workflow test coverage is incomplete. The V3 plan lifecycle (agents plan useagents plan executeagents plan apply) needs comprehensive Behave unit tests and Robot Framework integration tests covering all phase transitions, error cases, and edge conditions.

Expected Behavior

Complete test coverage for the V3 workflow including:

  • All phase transitions (strategize → execute → apply)
  • Error cases and recovery paths
  • Automation profile interactions
  • Decision tree recording and retrieval
  • Invariant enforcement during strategize
  • Correction modes (revert and append)

Acceptance Criteria

  • Behave scenarios cover all V3 plan lifecycle phase transitions
  • Behave scenarios cover error cases (invalid plan ID, wrong phase, etc.)
  • Robot Framework integration tests cover the full V3 workflow end-to-end
  • Test coverage for CLI module remains >= 97%
  • All new tests pass in CI

Supporting Information

  • Key files: src/cleveragents/cli/commands/plan.py (v3 commands: lines 1598–4000)
  • Test directories: features/ (Behave), robot/ (Robot Framework)
  • Related: #4181 (CLI help), #4182 (parent epic)

Subtasks

  • Audit existing V3 workflow test coverage using nox -s coverage_report
  • Identify missing Behave scenarios for V3 phase transitions
  • Add Behave scenarios: agents plan use creates plan with correct metadata
  • Add Behave scenarios: agents plan execute transitions plan through strategize and execute phases
  • Add Behave scenarios: agents plan apply applies changes and closes plan
  • Add Behave scenarios: error cases (invalid plan ID, wrong phase order)
  • Add Behave scenarios: automation profile interactions (manual vs auto-progress)
  • Add Robot Framework integration test: full V3 workflow end-to-end
  • Add Robot Framework integration test: correction flow (revert and append modes)
  • Verify coverage >= 97% via nox -s coverage_report
  • Run nox (all default sessions), fix any errors

Definition of Done

This issue is complete when:

  • All subtasks above are completed and checked off.
  • V3 workflow has complete Behave and Robot Framework test coverage.
  • A Git commit is created where the first line of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional details.
  • The commit is pushed to the remote on the branch matching the Branch in Metadata exactly.
  • The commit is submitted as a pull request to master, reviewed, and merged before this issue is marked done.
  • All nox stages pass.
  • Coverage >= 97%.

Automated by CleverAgents Bot
Supervisor: Product Builder | Agent: epic-planner

## Metadata - **Commit Message**: `test(cli): add complete V3 workflow end-to-end test coverage (Behave + Robot Framework)` - **Branch**: `test/v3-workflow-e2e-coverage` - **Parent Epic**: #4182 ## Background and Context Epic #4182 identifies that V3 workflow test coverage is incomplete. The V3 plan lifecycle (`agents plan use` → `agents plan execute` → `agents plan apply`) needs comprehensive Behave unit tests and Robot Framework integration tests covering all phase transitions, error cases, and edge conditions. ## Expected Behavior Complete test coverage for the V3 workflow including: - All phase transitions (strategize → execute → apply) - Error cases and recovery paths - Automation profile interactions - Decision tree recording and retrieval - Invariant enforcement during strategize - Correction modes (revert and append) ## Acceptance Criteria - [ ] Behave scenarios cover all V3 plan lifecycle phase transitions - [ ] Behave scenarios cover error cases (invalid plan ID, wrong phase, etc.) - [ ] Robot Framework integration tests cover the full V3 workflow end-to-end - [ ] Test coverage for CLI module remains >= 97% - [ ] All new tests pass in CI ## Supporting Information - **Key files**: `src/cleveragents/cli/commands/plan.py` (v3 commands: lines 1598–4000) - **Test directories**: `features/` (Behave), `robot/` (Robot Framework) - **Related**: #4181 (CLI help), #4182 (parent epic) ## Subtasks - [ ] Audit existing V3 workflow test coverage using `nox -s coverage_report` - [ ] Identify missing Behave scenarios for V3 phase transitions - [ ] Add Behave scenarios: `agents plan use` creates plan with correct metadata - [ ] Add Behave scenarios: `agents plan execute` transitions plan through strategize and execute phases - [ ] Add Behave scenarios: `agents plan apply` applies changes and closes plan - [ ] Add Behave scenarios: error cases (invalid plan ID, wrong phase order) - [ ] Add Behave scenarios: automation profile interactions (manual vs auto-progress) - [ ] Add Robot Framework integration test: full V3 workflow end-to-end - [ ] Add Robot Framework integration test: correction flow (revert and append modes) - [ ] Verify coverage >= 97% via `nox -s coverage_report` - [ ] Run `nox` (all default sessions), fix any errors ## Definition of Done This issue is complete when: - All subtasks above are completed and checked off. - V3 workflow has complete Behave and Robot Framework test coverage. - A Git commit is created where the **first line** of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional details. - The commit is pushed to the remote on the branch matching the **Branch** in Metadata exactly. - The commit is submitted as a **pull request** to `master`, reviewed, and **merged** before this issue is marked done. - All nox stages pass. - Coverage >= 97%. --- **Automated by CleverAgents Bot** Supervisor: Product Builder | Agent: epic-planner
HAL9000 added this to the v3.5.0 milestone 2026-04-08 17:42:55 +00:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Reference
cleveragents/cleveragents-core#4378
No description provided.