cleveragents/cleveragents-core

Fork 3

test(integration): workflow example 12 — large-scale hierarchical feature implementation (supervised profile) #776

New issue

Open

opened 2026-03-12 19:39:54 +00:00 by freemo · 1 comment

freemo commented

2026-03-12 19:39:54 +00:00

Owner

Metadata

Commit Message: test(integration): workflow example 12 — large-scale hierarchical feature implementation (supervised profile)
Branch: test/int-wf12-hierarchical

Background

Integration test for Specification Workflow Example 12: Large-Scale Feature Implementation with Hierarchical Decomposition. Exercises multi-project hierarchical child plans, error handling with plan correct --mode append, and phased apply using mocked LLM providers.

Runs within the standard nox -s integration_tests session using mocked LLM providers.

Expected Behavior

The integration test validates hierarchical decomposition with mocked LLM responses. Child plans spawn, error handling triggers correction, and phased apply proceeds in dependency order across 4 projects.

Acceptance Criteria

Robot Framework test suite in robot/ directory (standard integration tests)
Test registers 4 projects and exercises hierarchical plan decomposition
Test uses integration-appropriate mocking (mocked LLM providers)
Test exercises error handling and plan correct --mode append
Test verifies phased apply in dependency order
Test verifies plan tree parent-child relationships
Test passes via nox -s integration_tests
Coverage >=97% maintained

Subtasks

Write Robot Framework integration test suite for workflow example 12
Configure mocked LLM responses for hierarchical decomposition (including failure)
Create 4 temp project fixtures
Implement hierarchical decomposition workflow with error recovery
Verify via nox -s integration_tests
Verify coverage >=97% via nox -s coverage_report
Run nox (all default sessions), fix any errors

Definition of Done

This issue is complete when:

All subtasks above are completed and checked off.
A Git commit is created where the first line of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details.
The commit is pushed to the remote on the branch matching the Branch in Metadata exactly.
The commit is submitted as a pull request to master, reviewed, and merged before this issue is marked done.

## Metadata - **Commit Message**: `test(integration): workflow example 12 — large-scale hierarchical feature implementation (supervised profile)` - **Branch**: `test/int-wf12-hierarchical` ## Background Integration test for Specification Workflow Example 12: Large-Scale Feature Implementation with Hierarchical Decomposition. Exercises multi-project hierarchical child plans, error handling with `plan correct --mode append`, and phased apply using mocked LLM providers. Runs within the standard `nox -s integration_tests` session using mocked LLM providers. ## Expected Behavior The integration test validates hierarchical decomposition with mocked LLM responses. Child plans spawn, error handling triggers correction, and phased apply proceeds in dependency order across 4 projects. ## Acceptance Criteria - [ ] Robot Framework test suite in `robot/` directory (standard integration tests) - [ ] Test registers 4 projects and exercises hierarchical plan decomposition - [ ] Test uses integration-appropriate mocking (mocked LLM providers) - [ ] Test exercises error handling and `plan correct --mode append` - [ ] Test verifies phased apply in dependency order - [ ] Test verifies plan tree parent-child relationships - [ ] Test passes via `nox -s integration_tests` - [ ] Coverage >=97% maintained ## Subtasks - [ ] Write Robot Framework integration test suite for workflow example 12 - [ ] Configure mocked LLM responses for hierarchical decomposition (including failure) - [ ] Create 4 temp project fixtures - [ ] Implement hierarchical decomposition workflow with error recovery - [ ] Verify via `nox -s integration_tests` - [ ] Verify coverage >=97% via `nox -s coverage_report` - [ ] Run `nox` (all default sessions), fix any errors ## Definition of Done This issue is complete when: - All subtasks above are completed and checked off. - A Git commit is created where the **first line** of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details. - The commit is pushed to the remote on the branch matching the **Branch** in Metadata exactly. - The commit is submitted as a **pull request** to `master`, reviewed, and **merged** before this issue is marked done.

freemo added the

labels

2026-03-12 19:39:54 +00:00

brent.edwards was assigned by freemo

2026-03-12 19:39:55 +00:00

freemo added this to the v3.5.0 milestone

2026-03-12 19:39:55 +00:00

freemo added a new dependency

2026-03-12 19:39:55 +00:00

#401 Epic: Milestone Acceptance and Workflow Example Integration Tests

freemo added the

Points

label

2026-03-12 20:32:28 +00:00

brent.edwards added

and removed

labels

2026-03-14 06:09:15 +00:00

brent.edwards referenced this issue from a commit

2026-03-14 06:47:13 +00:00

test(integration): workflow example 12 — large-scale hierarchical feature implementation (supervised profile)

~~brent.edwards referenced this issue 2026-03-14 06:47:37 +00:00~~

test(integration): workflow example 12 — large-scale hierarchical feature implementation (supervised profile) #952

brent.edwards referenced this issue from a commit

2026-03-14 06:59:03 +00:00

test(integration): workflow example 12 — large-scale hierarchical feature implementation (supervised profile)

brent.edwards added

and removed

labels

2026-03-14 06:59:15 +00:00

brent.edwards commented

2026-03-14 06:59:36 +00:00

Member

Implementation Notes

Files Created

File	Lines	Description
`robot/wf12_hierarchical.robot`	78	5 Robot Framework test cases (240s timeout for multi-project setup)
`robot/helper_wf12_hierarchical.py`	485	Python helper with 5 subcommands

Test Cases

Multi-project setup with 4 projects and invariants
Hierarchical plan creation across 4 projects with typed args
Plan tree with child plan decisions (PROMPT_DEFINITION → STRATEGY_CHOICE → SUBPLAN_SPAWN × 2)
Correct mode append for failed child plan
Phased apply in dependency order

Quality Gates

Session	Result
`nox -s lint`	PASS
`nox -s typecheck`	PASS (0 errors)
`nox -s integration_tests`	PASS (all 5 WF12 tests)
Coverage	97.89% (>= 97%)

Commit

3eba00b8 on branch test/int-wf12-hierarchical (single squashed commit)

PR

PR #952

## Implementation Notes ### Files Created | File | Lines | Description | |---|---|---| | `robot/wf12_hierarchical.robot` | 78 | 5 Robot Framework test cases (240s timeout for multi-project setup) | | `robot/helper_wf12_hierarchical.py` | 485 | Python helper with 5 subcommands | ### Test Cases 1. Multi-project setup with 4 projects and invariants 2. Hierarchical plan creation across 4 projects with typed args 3. Plan tree with child plan decisions (PROMPT_DEFINITION → STRATEGY_CHOICE → SUBPLAN_SPAWN × 2) 4. Correct mode append for failed child plan 5. Phased apply in dependency order ### Quality Gates | Session | Result | |---|---| | `nox -s lint` | PASS | | `nox -s typecheck` | PASS (0 errors) | | `nox -s integration_tests` | PASS (all 5 WF12 tests) | | Coverage | 97.89% (>= 97%) | ### Commit `3eba00b8` on branch `test/int-wf12-hierarchical` (single squashed commit) ### PR [PR #952](https://git.cleverthis.com/cleveragents/cleveragents-core/pulls/952)

brent.edwards referenced this issue from a pull request that will close it,

2026-03-14 19:49:30 +00:00

test(integration): workflow example 12 — large-scale hierarchical feature implementation (supervised profile) #952

brent.edwards referenced this issue from a commit

2026-03-15 04:41:17 +00:00

test(integration): workflow example 12 — large-scale hierarchical feature implementation (supervised profile)

brent.edwards referenced this issue from a commit

2026-03-15 19:39:53 +00:00

test(integration): workflow example 12 — large-scale hierarchical feature implementation (supervised profile)

freemo referenced this issue from a commit

2026-03-16 02:40:11 +00:00

test(robot): add TDD tags (tdd_issue, tdd_issue_776, tdd_expected_fail) to wf12