UAT: agents plan correct CLI output is missing spec-required panels (Affected Subtree, Sandbox Rollback, Recompute, History) #4904

Open
opened 2026-04-08 20:18:04 +00:00 by HAL9000 · 2 comments
Owner

Bug Report

Feature Area: Correction Model — agents plan correct CLI output format
Severity: Medium (functional but output is incomplete vs spec)
Found by: UAT tester, code analysis
Spec reference: docs/specification.md §agents plan correct command (lines ~14930–15082)


What Was Tested

The agents plan correct command's Rich and JSON output format was compared against the specification.

Expected Behavior (from spec)

The spec defines a rich multi-panel output for agents plan correct:

╭─ Correction ────────────────────────────────────────╮
│ Mode: revert                                        │
│ Impact: 3 decisions, 2 child plans, 5 artifacts     │
│ New Decision: 01HXM9B7Z3Q1Q8K2E9H7K3W2M8            │
│ Corrects: 01HXM9A1C2Q7W3R5G8Z0P4Q1X9                │
│ Attempt: 2                                          │
╰─────────────────────────────────────────────────────╯

╭─ Affected Subtree ──────────────╮
│ Decisions Invalidated: 3        │
│ Child Plans Rolled Back: 2      │
│ Artifacts Archived: 5           │
│ Unaffected Decisions: 2         │
╰─────────────────────────────────╯

╭─ Sandbox Rollback ─────────────╮
│ Checkpoint: cp_01HXM8C2        │
│ Files Reverted: 5              │
│ Status: restored               │
╰────────────────────────────────╯

╭─ Recompute ──────────────╮
│ Queued: 2 child plans    │
│ ETA: 4m                  │
╰──────────────────────────╯

╭─ History ───────────────────────────────────────────╮
│ - Original decision superseded                      │
│ - Prior artifacts archived for comparison           │
│ - agents plan diff --correction 01HXM9B7Z3Q1Q8K2..  │
╰─────────────────────────────────────────────────────╯

✓ OK Correction applied

The JSON output should include correction, affected_subtree, sandbox_rollback, recompute, and history sections.

Actual Behavior

The implementation at src/cleveragents/cli/commands/plan.py lines 3334–3341 outputs only:

✓ Correction applied: <correction_id>
  Reverted: <decision_ids>   (if any)
  New decisions: <decision_ids>   (if any)

The non-rich (JSON/YAML) output is also minimal:

{
  "correction_id": "...",
  "status": "applied",
  "mode": "revert",
  "new_decisions": [],
  "reverted_decisions": ["D1"]
}

Missing from the output:

  • Correction panel: Impact summary, New Decision, Corrects, Attempt number
  • Affected Subtree panel: Decisions Invalidated, Child Plans Rolled Back, Artifacts Archived, Unaffected Decisions
  • Sandbox Rollback panel: Checkpoint, Files Reverted, Status
  • Recompute panel: Queued, ETA
  • History panel: superseded decision note, archived artifacts note, agents plan diff --correction hint
  • Structured JSON envelope: command, status, exit_code, data, timing, messages fields

Code Location

  • src/cleveragents/cli/commands/plan.py, lines 3325–3341 (correct_decision function, output section)

Impact

  • Users get minimal feedback after applying a correction — no visibility into what was affected
  • The spec's "History" panel provides the follow-up agents plan diff --correction command hint, which is missing
  • JSON/YAML consumers cannot parse structured correction results
  • The Attempt counter (spec safety guarantee: "Create a new attempt revision") is not shown

Automated by CleverAgents Bot
Supervisor: UAT Testing | Agent: uat-tester

## Bug Report **Feature Area:** Correction Model — `agents plan correct` CLI output format **Severity:** Medium (functional but output is incomplete vs spec) **Found by:** UAT tester, code analysis **Spec reference:** `docs/specification.md` §`agents plan correct` command (lines ~14930–15082) --- ### What Was Tested The `agents plan correct` command's Rich and JSON output format was compared against the specification. ### Expected Behavior (from spec) The spec defines a rich multi-panel output for `agents plan correct`: ``` ╭─ Correction ────────────────────────────────────────╮ │ Mode: revert │ │ Impact: 3 decisions, 2 child plans, 5 artifacts │ │ New Decision: 01HXM9B7Z3Q1Q8K2E9H7K3W2M8 │ │ Corrects: 01HXM9A1C2Q7W3R5G8Z0P4Q1X9 │ │ Attempt: 2 │ ╰─────────────────────────────────────────────────────╯ ╭─ Affected Subtree ──────────────╮ │ Decisions Invalidated: 3 │ │ Child Plans Rolled Back: 2 │ │ Artifacts Archived: 5 │ │ Unaffected Decisions: 2 │ ╰─────────────────────────────────╯ ╭─ Sandbox Rollback ─────────────╮ │ Checkpoint: cp_01HXM8C2 │ │ Files Reverted: 5 │ │ Status: restored │ ╰────────────────────────────────╯ ╭─ Recompute ──────────────╮ │ Queued: 2 child plans │ │ ETA: 4m │ ╰──────────────────────────╯ ╭─ History ───────────────────────────────────────────╮ │ - Original decision superseded │ │ - Prior artifacts archived for comparison │ │ - agents plan diff --correction 01HXM9B7Z3Q1Q8K2.. │ ╰─────────────────────────────────────────────────────╯ ✓ OK Correction applied ``` The JSON output should include `correction`, `affected_subtree`, `sandbox_rollback`, `recompute`, and `history` sections. ### Actual Behavior The implementation at `src/cleveragents/cli/commands/plan.py` lines 3334–3341 outputs only: ``` ✓ Correction applied: <correction_id> Reverted: <decision_ids> (if any) New decisions: <decision_ids> (if any) ``` The non-rich (JSON/YAML) output is also minimal: ```json { "correction_id": "...", "status": "applied", "mode": "revert", "new_decisions": [], "reverted_decisions": ["D1"] } ``` Missing from the output: - **Correction panel**: `Impact` summary, `New Decision`, `Corrects`, `Attempt` number - **Affected Subtree panel**: `Decisions Invalidated`, `Child Plans Rolled Back`, `Artifacts Archived`, `Unaffected Decisions` - **Sandbox Rollback panel**: `Checkpoint`, `Files Reverted`, `Status` - **Recompute panel**: `Queued`, `ETA` - **History panel**: superseded decision note, archived artifacts note, `agents plan diff --correction` hint - **Structured JSON envelope**: `command`, `status`, `exit_code`, `data`, `timing`, `messages` fields ### Code Location - `src/cleveragents/cli/commands/plan.py`, lines 3325–3341 (`correct_decision` function, output section) ### Impact - Users get minimal feedback after applying a correction — no visibility into what was affected - The spec's "History" panel provides the follow-up `agents plan diff --correction` command hint, which is missing - JSON/YAML consumers cannot parse structured correction results - The `Attempt` counter (spec safety guarantee: "Create a new attempt revision") is not shown --- **Automated by CleverAgents Bot** Supervisor: UAT Testing | Agent: uat-tester
Owner

Issue triaged by project owner:

  • State: Verified
  • Priority: Medium — CLI output missing spec-required panels for agents plan correct
  • Milestone: v3.3.0 — Corrections CLI is M4 scope
  • Story Points: 3 — M — Adding missing panels to correction output display
  • MoSCoW: Should Have — CLI output completeness is important for usability but not blocking core functionality
  • Parent Epic: #358 (Corrections + Subplans + Checkpoints M4)

Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: project-owner

Issue triaged by project owner: - **State**: Verified - **Priority**: Medium — CLI output missing spec-required panels for `agents plan correct` - **Milestone**: v3.3.0 — Corrections CLI is M4 scope - **Story Points**: 3 — M — Adding missing panels to correction output display - **MoSCoW**: Should Have — CLI output completeness is important for usability but not blocking core functionality - **Parent Epic**: #358 (Corrections + Subplans + Checkpoints M4) --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: project-owner
freemo added this to the v3.3.0 milestone 2026-04-08 23:39:30 +00:00
Owner

Issue triaged by project owner:

  • State: Verified
  • Priority: Medium — CLI output is functional but missing spec-required panels (Affected Subtree, Sandbox Rollback, Recompute, History)
  • Milestone: v3.3.0 (Corrections + Subplans + Checkpoints)
  • Story Points: 5 — L — Adding 4 missing rich panels to the correction CLI output requires significant UI work
  • MoSCoW: Should Have — Complete correction output is important for operator visibility but core correction functionality still works
  • Parent Epic: #4942 (Decision Intelligence Legendary)

Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: project-owner

Issue triaged by project owner: - **State**: Verified - **Priority**: Medium — CLI output is functional but missing spec-required panels (Affected Subtree, Sandbox Rollback, Recompute, History) - **Milestone**: v3.3.0 (Corrections + Subplans + Checkpoints) - **Story Points**: 5 — L — Adding 4 missing rich panels to the correction CLI output requires significant UI work - **MoSCoW**: Should Have — Complete correction output is important for operator visibility but core correction functionality still works - **Parent Epic**: #4942 (Decision Intelligence Legendary) --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: project-owner
Sign in to join this conversation.
No milestone
No project
No assignees
2 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Reference
cleveragents/cleveragents-core#4904
No description provided.