UAT: `agents automation-profile add` rich output title is "Profile Added" instead of spec-required "Profile Registered", missing "Created:" timestamp and separate "Confidence Thresholds" panel #2923

New issue

Open

opened 2026-04-05 02:49:54 +00:00 by freemo · 1 comment

freemo commented

2026-04-05 02:49:54 +00:00

Owner

Metadata

Branch: fix/automation-profile-add-rich-output-spec-compliance
Commit Message: fix(cli): correct automation-profile add rich output title, timestamp, and panel layout per spec
Milestone: v3.7.0
Parent Epic: #362

Summary

The agents automation-profile add command's rich output deviates from the specification in three ways:

The panel title is "Profile Added" instead of "Profile Registered"
The output is missing a "Created:" timestamp field
The output uses a single combined panel instead of separate "Profile Registered" and "Confidence Thresholds" panels

Expected Behavior (from spec)

From docs/specification.md section "agents automation-profile add", the rich output should render:

╭─ Profile Registered ─────────────────────────────────────────────╮
│ Name: local/careful-auto                                          │
│ Description: Autonomous execution with mandatory sandbox          │
│              and manual apply                                     │
│ Created: 2026-02-08 14:30                                         │
╰───────────────────────────────────────────────────────────────────╯

╭─ Confidence Thresholds ────────────────╮
│ decompose_task: 0.0                    │
│ create_tool: 0.0                       │
│ select_tool: 1.0                       │
│ edit_code: 0.0                         │
│ execute_command: 0.0                   │
│ create_file: 0.0                       │
│ delete_content: 1.0                    │
│ access_network: 1.0                    │
│ install_dependency: 0.0                │
│ modify_config: 0.0                     │
│ approve_plan: 0.0                      │
│ require_sandbox: true                  │
│ require_checkpoints: true              │
│ allow_unsafe_tools: false              │
╰────────────────────────────────────────╯

✓ OK Profile registered

Actual Behavior

The implementation in src/cleveragents/cli/commands/automation_profile.py (line 244) sets title = "Profile Added" (not "Profile Registered"). The _print_profile() function (lines 122-174) renders a single panel with all profile details, with no "Created:" timestamp and no separate "Confidence Thresholds" panel.

Code Location

src/cleveragents/cli/commands/automation_profile.py:

Line 244: title = "Profile Added" — should be "Profile Registered"
Lines 122-174: _print_profile() — missing "Created:" field, missing separate "Confidence Thresholds" panel

Steps to Reproduce

agents automation-profile add --config ./my-profile.yaml

Observe that the panel title says "Profile Added" instead of "Profile Registered", no "Created:" timestamp is shown, and all content is in a single panel.

Impact

The output does not match the spec's documented format, causing confusion for users comparing against documentation.

Subtasks

Change title = "Profile Added" to title = "Profile Registered" at line 244 of automation_profile.py
Add Created: timestamp field to the first panel in _print_profile() (or the add command's output function)
Split the single combined panel into two separate panels: "Profile Registered" (name, description, created) and "Confidence Thresholds" (all threshold fields)
Update the success message to read ✓ OK Profile registered
Write a failing Behave scenario that reproduces each of the three deviations before fixing
Verify all three deviations are resolved and the output matches the spec exactly
Update any related Robot Framework integration tests to assert the correct panel structure

Definition of Done

Panel title reads "Profile Registered" (not "Profile Added")
"Created:" timestamp field is present in the "Profile Registered" panel
Output renders two separate panels: "Profile Registered" and "Confidence Thresholds"
Success message reads ✓ OK Profile registered
Failing Behave scenario created before fix (TDD)
All Behave scenarios for automation-profile add output pass
Robot Framework integration tests updated and passing
PR linked and merged into the target branch
All nox stages pass
Coverage >= 97%

Automated by CleverAgents Bot
Supervisor: UAT Testing | Agent: ca-new-issue-creator

## Metadata - **Branch**: `fix/automation-profile-add-rich-output-spec-compliance` - **Commit Message**: `fix(cli): correct automation-profile add rich output title, timestamp, and panel layout per spec` - **Milestone**: v3.7.0 - **Parent Epic**: #362 ## Summary The `agents automation-profile add` command's rich output deviates from the specification in three ways: 1. The panel title is "Profile Added" instead of "Profile Registered" 2. The output is missing a "Created:" timestamp field 3. The output uses a single combined panel instead of separate "Profile Registered" and "Confidence Thresholds" panels ## Expected Behavior (from spec) From `docs/specification.md` section "agents automation-profile add", the rich output should render: ``` ╭─ Profile Registered ─────────────────────────────────────────────╮ │ Name: local/careful-auto │ │ Description: Autonomous execution with mandatory sandbox │ │ and manual apply │ │ Created: 2026-02-08 14:30 │ ╰───────────────────────────────────────────────────────────────────╯ ╭─ Confidence Thresholds ────────────────╮ │ decompose_task: 0.0 │ │ create_tool: 0.0 │ │ select_tool: 1.0 │ │ edit_code: 0.0 │ │ execute_command: 0.0 │ │ create_file: 0.0 │ │ delete_content: 1.0 │ │ access_network: 1.0 │ │ install_dependency: 0.0 │ │ modify_config: 0.0 │ │ approve_plan: 0.0 │ │ require_sandbox: true │ │ require_checkpoints: true │ │ allow_unsafe_tools: false │ ╰────────────────────────────────────────╯ ✓ OK Profile registered ``` ## Actual Behavior The implementation in `src/cleveragents/cli/commands/automation_profile.py` (line 244) sets `title = "Profile Added"` (not "Profile Registered"). The `_print_profile()` function (lines 122-174) renders a single panel with all profile details, with no "Created:" timestamp and no separate "Confidence Thresholds" panel. ## Code Location `src/cleveragents/cli/commands/automation_profile.py`: - Line 244: `title = "Profile Added"` — should be `"Profile Registered"` - Lines 122-174: `_print_profile()` — missing "Created:" field, missing separate "Confidence Thresholds" panel ## Steps to Reproduce ```bash agents automation-profile add --config ./my-profile.yaml ``` Observe that the panel title says "Profile Added" instead of "Profile Registered", no "Created:" timestamp is shown, and all content is in a single panel. ## Impact The output does not match the spec's documented format, causing confusion for users comparing against documentation. ## Subtasks - [ ] Change `title = "Profile Added"` to `title = "Profile Registered"` at line 244 of `automation_profile.py` - [ ] Add `Created:` timestamp field to the first panel in `_print_profile()` (or the `add` command's output function) - [ ] Split the single combined panel into two separate panels: "Profile Registered" (name, description, created) and "Confidence Thresholds" (all threshold fields) - [ ] Update the success message to read `✓ OK Profile registered` - [ ] Write a failing Behave scenario that reproduces each of the three deviations before fixing - [ ] Verify all three deviations are resolved and the output matches the spec exactly - [ ] Update any related Robot Framework integration tests to assert the correct panel structure ## Definition of Done - [ ] Panel title reads "Profile Registered" (not "Profile Added") - [ ] "Created:" timestamp field is present in the "Profile Registered" panel - [ ] Output renders two separate panels: "Profile Registered" and "Confidence Thresholds" - [ ] Success message reads `✓ OK Profile registered` - [ ] Failing Behave scenario created before fix (TDD) - [ ] All Behave scenarios for `automation-profile add` output pass - [ ] Robot Framework integration tests updated and passing - [ ] PR linked and merged into the target branch - All nox stages pass - Coverage >= 97% --- **Automated by CleverAgents Bot** Supervisor: UAT Testing | Agent: ca-new-issue-creator

freemo added this to the v3.7.0 milestone

2026-04-05 02:50:02 +00:00

freemo added a new dependency

2026-04-05 02:50:50 +00:00

#362 Epic: Security & Safety Hardening

freemo commented

2026-04-05 02:52:17 +00:00

Author

Owner

Issue triaged by project owner:

State: Verified
Priority: Medium (confirmed)
MoSCoW: Should Have — spec compliance issue

Valid UAT finding verified during batch triage.

Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: ca-project-owner

Issue triaged by project owner: - **State**: Verified - **Priority**: Medium (confirmed) - **MoSCoW**: Should Have — spec compliance issue Valid UAT finding verified during batch triage. --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: ca-project-owner

freemo referenced this issue

2026-04-05 02:56:49 +00:00

[CA-AUTO] System Watchdog — Session Tracker #2877

freemo referenced this issue

2026-04-05 02:57:33 +00:00

UAT: agents automation-profile add JSON output uses wrong structure — phase_transitions/decision_automation/self_repair/execution_controls instead of spec-required thresholds/flags #2960