cleveragents/cleveragents-core

Fork 3

test(integration): workflow example 3 — multi-file refactoring with invariants (cautious profile) #767

New issue

Open

opened 2026-03-12 19:38:57 +00:00 by freemo · 1 comment

freemo commented

2026-03-12 19:38:57 +00:00

Owner

Metadata

Commit Message: test(integration): workflow example 3 — multi-file refactoring with invariants (cautious profile)
Branch: test/int-wf03-refactoring

Background

Integration test for Specification Workflow Example 3: Multi-File Refactoring with Invariants. Exercises the cautious automation profile with multi-scope invariants, custom actor registration, confidence-threshold pausing, and plan correct --mode revert using mocked LLM providers.

Runs within the standard nox -s integration_tests session using mocked LLM providers.

Expected Behavior

The integration test validates cautious-profile refactoring with deterministic mocked LLM responses. The mock produces a low-confidence decision that triggers pausing, enabling testing of the correction/revert flow.

Acceptance Criteria

Robot Framework test suite in robot/ directory (standard integration tests)
Test exercises cautious-profile workflow with multi-scope invariants
Test uses integration-appropriate mocking (mocked LLM providers)
Test verifies confidence-threshold pausing behavior
Test exercises plan explain, plan correct --mode revert, and plan prompt
Test verifies corrected execution output
Test passes via nox -s integration_tests
Coverage >=97% maintained

Subtasks

Write Robot Framework integration test suite for workflow example 3
Configure mocked LLM responses for refactoring scenario (including low-confidence decision)
Create temp project fixture with raw SQL auth module
Implement cautious-profile workflow with correction flow
Verify via nox -s integration_tests
Verify coverage >=97% via nox -s coverage_report
Run nox (all default sessions), fix any errors

Definition of Done

This issue is complete when:

All subtasks above are completed and checked off.
A Git commit is created where the first line of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details.
The commit is pushed to the remote on the branch matching the Branch in Metadata exactly.
The commit is submitted as a pull request to master, reviewed, and merged before this issue is marked done.

## Metadata - **Commit Message**: `test(integration): workflow example 3 — multi-file refactoring with invariants (cautious profile)` - **Branch**: `test/int-wf03-refactoring` ## Background Integration test for Specification Workflow Example 3: Multi-File Refactoring with Invariants. Exercises the `cautious` automation profile with multi-scope invariants, custom actor registration, confidence-threshold pausing, and `plan correct --mode revert` using mocked LLM providers. Runs within the standard `nox -s integration_tests` session using mocked LLM providers. ## Expected Behavior The integration test validates cautious-profile refactoring with deterministic mocked LLM responses. The mock produces a low-confidence decision that triggers pausing, enabling testing of the correction/revert flow. ## Acceptance Criteria - [ ] Robot Framework test suite in `robot/` directory (standard integration tests) - [ ] Test exercises cautious-profile workflow with multi-scope invariants - [ ] Test uses integration-appropriate mocking (mocked LLM providers) - [ ] Test verifies confidence-threshold pausing behavior - [ ] Test exercises `plan explain`, `plan correct --mode revert`, and `plan prompt` - [ ] Test verifies corrected execution output - [ ] Test passes via `nox -s integration_tests` - [ ] Coverage >=97% maintained ## Subtasks - [ ] Write Robot Framework integration test suite for workflow example 3 - [ ] Configure mocked LLM responses for refactoring scenario (including low-confidence decision) - [ ] Create temp project fixture with raw SQL auth module - [ ] Implement cautious-profile workflow with correction flow - [ ] Verify via `nox -s integration_tests` - [ ] Verify coverage >=97% via `nox -s coverage_report` - [ ] Run `nox` (all default sessions), fix any errors ## Definition of Done This issue is complete when: - All subtasks above are completed and checked off. - A Git commit is created where the **first line** of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details. - The commit is pushed to the remote on the branch matching the **Branch** in Metadata exactly. - The commit is submitted as a **pull request** to `master`, reviewed, and **merged** before this issue is marked done.

freemo added the

labels

2026-03-12 19:38:57 +00:00

brent.edwards was assigned by freemo

2026-03-12 19:38:57 +00:00

freemo added this to the v3.2.0 milestone

2026-03-12 19:38:57 +00:00

freemo added a new dependency

2026-03-12 19:38:58 +00:00

#401 Epic: Milestone Acceptance and Workflow Example Integration Tests

freemo added the

Points

label

2026-03-12 20:32:27 +00:00

brent.edwards added

and removed

labels

2026-03-14 01:05:52 +00:00

brent.edwards referenced this issue from a commit

2026-03-14 02:20:44 +00:00

test(integration): workflow example 3 — multi-file refactoring with invariants (cautious profile)

~~brent.edwards referenced this issue 2026-03-14 02:21:11 +00:00~~

test(integration): workflow example 3 — multi-file refactoring with invariants (cautious profile) #944

brent.edwards added

and removed

labels

2026-03-14 04:01:46 +00:00

brent.edwards commented

2026-03-14 04:02:04 +00:00

Member

Implementation Notes

Files Created

File	Lines	Description
`robot/wf03_refactoring.robot`	74	5 Robot Framework test cases
`robot/helper_wf03_refactoring.py`	497	Python helper with 5 subcommands

Test Coverage

5 test cases covering the full WF03 workflow: invariant management (global + project scope), actor/action creation with cautious profile and typed arguments, plan lifecycle with --automation-profile cautious, decision tree + explain, and plan correct --mode revert.

Quality Gates

Session	Result
`nox -s lint`	PASS
`nox -s typecheck`	PASS (0 errors)
`nox -s integration_tests`	PASS (all 5 WF03 tests)

Commit

218be0b72b319512fbdef3136109ee278f1bd635 on branch test/int-wf03-refactoring

PR

PR #944

## Implementation Notes ### Files Created | File | Lines | Description | |---|---|---| | `robot/wf03_refactoring.robot` | 74 | 5 Robot Framework test cases | | `robot/helper_wf03_refactoring.py` | 497 | Python helper with 5 subcommands | ### Test Coverage 5 test cases covering the full WF03 workflow: invariant management (global + project scope), actor/action creation with cautious profile and typed arguments, plan lifecycle with `--automation-profile cautious`, decision tree + explain, and plan correct --mode revert. ### Quality Gates | Session | Result | |---|---| | `nox -s lint` | PASS | | `nox -s typecheck` | PASS (0 errors) | | `nox -s integration_tests` | PASS (all 5 WF03 tests) | ### Commit `218be0b72b319512fbdef3136109ee278f1bd635` on branch `test/int-wf03-refactoring` ### PR [PR #944](https://git.cleverthis.com/cleveragents/cleveragents-core/pulls/944)

freemo referenced this issue

2026-03-14 04:40:05 +00:00

test(integration): workflow example 3 — multi-file refactoring with invariants (cautious profile) #944

brent.edwards referenced this issue from a commit

2026-03-15 04:35:45 +00:00

test(integration): workflow example 3 — multi-file refactoring with invariants (cautious profile)

brent.edwards referenced this issue from a commit

2026-03-15 19:40:04 +00:00

test(integration): workflow example 3 — multi-file refactoring with invariants (cautious profile)