cleveragents/cleveragents-core

Fork 3

UAT: `agents automation-profile list` rich table columns differ from spec — shows Decompose/Create Tool/Select Tool instead of spec-required "Auto-Apply" column #2942

New issue

Open

opened 2026-04-05 02:53:24 +00:00 by freemo · 2 comments

freemo commented

2026-04-05 02:53:24 +00:00

Owner

Metadata

Branch: fix/automation-profile-list-table-columns-spec-compliance
Commit Message: fix(cli): correct automation-profile list table columns and add Summary panel per spec
Milestone: v3.7.0
Parent Epic: #362

Summary

The agents automation-profile list command's rich table output uses different columns than specified. The spec defines a table with columns: Name, Source, Auto-Apply, Sandbox, Description. The implementation renders: Name, Source, Description, Decompose, Create Tool, Select Tool, Sandbox.

Expected Behavior (from spec)

From docs/specification.md section "agents automation-profile list", the rich output table should have these columns:

╭─ Automation Profiles ──────────────────────────────────────────────────────────╮
│ Name                Source    Auto-Apply  Sandbox  Description                 │
│ ──────────────────  ────────  ──────────  ───────  ────────────────────────    │
│ manual             built-in  1.0         yes      Human-driven (default)       │
│ review             built-in  1.0         yes      Auto-phase, manual decisions │
│ supervised         built-in  1.0         yes      Auto-plan, manual exec       │
│ cautious           built-in  1.0         yes      Confidence-gated automation  │
│ trusted            built-in  1.0         yes      Auto-exec, manual apply      │
│ auto               built-in  1.0         yes      Full auto except apply       │
│ ci                 built-in  0.0         yes      Full auto, safe CI/CD        │
│ full-auto          built-in  0.0         no       Complete automation          │
╰────────────────────────────────────────────────────────────────────────────────╯

Columns: Name, Source, Auto-Apply, Sandbox, Description

The "Auto-Apply" column shows the select_tool threshold value (the threshold for the apply phase).

Additionally, the spec requires a "Summary" panel below the table:

╭─ Summary ───────────╮
│ Built-in: 8         │
│ Custom: 1           │
│ Total: 9            │
╰─────────────────────╯

Actual Behavior

The implementation in src/cleveragents/cli/commands/automation_profile.py (lines 391-413) renders a table with columns: Name, Source, Description, Decompose, Create Tool, Select Tool, Sandbox

table.add_column("Name", style="cyan")
table.add_column("Source", style="blue")
table.add_column("Description", style="dim")
table.add_column("Decompose", justify="right")
table.add_column("Create Tool", justify="right")
table.add_column("Select Tool", justify="right")
table.add_column("Sandbox", justify="center")

This shows three separate threshold columns (Decompose, Create Tool, Select Tool) instead of the single "Auto-Apply" column. The column order also differs (Description appears before threshold columns in the implementation, but after Sandbox in the spec). The Summary panel is also absent.

Code Location

src/cleveragents/cli/commands/automation_profile.py:

Lines 391-413: list_profiles() command — table column definitions and row rendering

Steps to Reproduce

agents automation-profile list

Observe that the table shows Decompose, Create Tool, Select Tool columns instead of a single Auto-Apply column, and no Summary panel is shown.

Impact

The list output does not match the spec's documented format, making it harder for users to quickly assess the apply-phase automation level of each profile.

Subtasks

Replace the three threshold columns (Decompose, Create Tool, Select Tool) with a single "Auto-Apply" column showing the select_tool threshold value
Reorder table columns to match spec: Name, Source, Auto-Apply, Sandbox, Description
Add the "Summary" panel below the table showing Built-in, Custom, and Total counts
Update Behave unit test scenarios for automation-profile list rich output to assert the new column layout and Summary panel
Update Robot Framework integration tests for automation-profile list to verify the rendered table structure
Verify nox -e lint and nox -e typecheck pass with no errors

Definition of Done

agents automation-profile list renders a table with columns: Name, Source, Auto-Apply, Sandbox, Description (in that order)
The "Auto-Apply" column value is derived from the select_tool threshold of each profile
A "Summary" panel is rendered below the table with Built-in, Custom, and Total counts
All Behave scenarios for automation-profile list pass
All Robot Framework integration tests for automation-profile list pass
All nox stages pass
Coverage >= 97%

Automated by CleverAgents Bot
Supervisor: UAT Testing | Agent: ca-new-issue-creator

## Metadata - **Branch**: `fix/automation-profile-list-table-columns-spec-compliance` - **Commit Message**: `fix(cli): correct automation-profile list table columns and add Summary panel per spec` - **Milestone**: v3.7.0 - **Parent Epic**: #362 ## Summary The `agents automation-profile list` command's rich table output uses different columns than specified. The spec defines a table with columns: Name, Source, Auto-Apply, Sandbox, Description. The implementation renders: Name, Source, Description, Decompose, Create Tool, Select Tool, Sandbox. ## Expected Behavior (from spec) From `docs/specification.md` section "agents automation-profile list", the rich output table should have these columns: ``` ╭─ Automation Profiles ──────────────────────────────────────────────────────────╮ │ Name Source Auto-Apply Sandbox Description │ │ ────────────────── ──────── ────────── ─────── ──────────────────────── │ │ manual built-in 1.0 yes Human-driven (default) │ │ review built-in 1.0 yes Auto-phase, manual decisions │ │ supervised built-in 1.0 yes Auto-plan, manual exec │ │ cautious built-in 1.0 yes Confidence-gated automation │ │ trusted built-in 1.0 yes Auto-exec, manual apply │ │ auto built-in 1.0 yes Full auto except apply │ │ ci built-in 0.0 yes Full auto, safe CI/CD │ │ full-auto built-in 0.0 no Complete automation │ ╰────────────────────────────────────────────────────────────────────────────────╯ ``` Columns: **Name, Source, Auto-Apply, Sandbox, Description** The "Auto-Apply" column shows the `select_tool` threshold value (the threshold for the apply phase). Additionally, the spec requires a "Summary" panel below the table: ``` ╭─ Summary ───────────╮ │ Built-in: 8 │ │ Custom: 1 │ │ Total: 9 │ ╰─────────────────────╯ ``` ## Actual Behavior The implementation in `src/cleveragents/cli/commands/automation_profile.py` (lines 391-413) renders a table with columns: **Name, Source, Description, Decompose, Create Tool, Select Tool, Sandbox** ```python table.add_column("Name", style="cyan") table.add_column("Source", style="blue") table.add_column("Description", style="dim") table.add_column("Decompose", justify="right") table.add_column("Create Tool", justify="right") table.add_column("Select Tool", justify="right") table.add_column("Sandbox", justify="center") ``` This shows three separate threshold columns (Decompose, Create Tool, Select Tool) instead of the single "Auto-Apply" column. The column order also differs (Description appears before threshold columns in the implementation, but after Sandbox in the spec). The Summary panel is also absent. ## Code Location `src/cleveragents/cli/commands/automation_profile.py`: - Lines 391-413: `list_profiles()` command — table column definitions and row rendering ## Steps to Reproduce ```bash agents automation-profile list ``` Observe that the table shows Decompose, Create Tool, Select Tool columns instead of a single Auto-Apply column, and no Summary panel is shown. ## Impact The list output does not match the spec's documented format, making it harder for users to quickly assess the apply-phase automation level of each profile. ## Subtasks - [ ] Replace the three threshold columns (Decompose, Create Tool, Select Tool) with a single "Auto-Apply" column showing the `select_tool` threshold value - [ ] Reorder table columns to match spec: Name, Source, Auto-Apply, Sandbox, Description - [ ] Add the "Summary" panel below the table showing Built-in, Custom, and Total counts - [ ] Update Behave unit test scenarios for `automation-profile list` rich output to assert the new column layout and Summary panel - [ ] Update Robot Framework integration tests for `automation-profile list` to verify the rendered table structure - [ ] Verify `nox -e lint` and `nox -e typecheck` pass with no errors ## Definition of Done - [ ] `agents automation-profile list` renders a table with columns: Name, Source, Auto-Apply, Sandbox, Description (in that order) - [ ] The "Auto-Apply" column value is derived from the `select_tool` threshold of each profile - [ ] A "Summary" panel is rendered below the table with Built-in, Custom, and Total counts - [ ] All Behave scenarios for `automation-profile list` pass - [ ] All Robot Framework integration tests for `automation-profile list` pass - [ ] All nox stages pass - [ ] Coverage >= 97% --- **Automated by CleverAgents Bot** Supervisor: UAT Testing | Agent: ca-new-issue-creator

freemo added this to the v3.7.0 milestone

2026-04-05 02:53:31 +00:00

freemo added a new dependency

2026-04-05 02:53:44 +00:00

#362 Epic: Security & Safety Hardening

freemo commented

2026-04-05 02:54:20 +00:00

Author

Owner

Label compliance fix applied:

Added missing labels: Priority/Medium, State/Unverified, Type/Bug
Reason: Issue was missing all required labels per CONTRIBUTING.md. Inferred Type/Bug from the "UAT:" prefix and bug description. Applied Priority/Medium and State/Unverified as defaults.

Automated by CleverAgents Bot
Supervisor: Backlog Grooming | Agent: ca-backlog-groomer

Label compliance fix applied: - Added missing labels: `Priority/Medium`, `State/Unverified`, `Type/Bug` - Reason: Issue was missing all required labels per CONTRIBUTING.md. Inferred `Type/Bug` from the "UAT:" prefix and bug description. Applied `Priority/Medium` and `State/Unverified` as defaults. --- **Automated by CleverAgents Bot** Supervisor: Backlog Grooming | Agent: ca-backlog-groomer

freemo referenced this issue

2026-04-05 02:54:44 +00:00

[CA-AUTO] Backlog Groomer — groomer-1 — Session Tracker #2771

freemo commented

2026-04-05 03:01:14 +00:00

Author

Owner

Issue triaged by project owner:

State: Verified
Priority: Confirmed
MoSCoW: Should Have

Valid finding verified during batch triage.

Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: ca-project-owner

Issue triaged by project owner: - **State**: Verified - **Priority**: Confirmed - **MoSCoW**: Should Have Valid finding verified during batch triage. --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: ca-project-owner

freemo referenced this issue

2026-04-05 06:15:22 +00:00

[CA-AUTO] UAT Pool Supervisor — v3.2.0–v3.7.0 — Session Tracker #3094