Epic: E2E Workflow Specification Tests & Code Review Tool Examples #3374
Labels
No labels
auto/needs-reevaluation
controller-managed
auto/blocked-by-deps
auto/ci-timeout
auto/claimed-implementer
auto/claimed-merge
auto/claimed-reviewer
auto/driver-down
auto/invariant-violation
auto/last-attempt-tier-0
auto/last-attempt-tier-1
auto/last-attempt-tier-2
auto/last-attempt-tier-min
Automation Tracking
auto/needs-conflict-resolution
auto/needs-implementer
auto/postmortem
auto/ready-to-merge
auto/restart-throttled
auto/revert
auto/sentinel
auto/stale-inactivity
auto/unstable
Blocked
Bounty
$100
Bounty
$1000
Bounty
$10000
Bounty
$20
Bounty
$2000
Bounty
$250
Bounty
$50
Bounty
$500
Bounty
$5000
Bounty
$750
MoSCoW
Could have
MoSCoW
Must have
MoSCoW
Should have
Needs Feedback
Points
1
Points
13
Points
2
Points
21
Points
3
Points
34
Points
5
Points
55
Points
8
Points
88
Priority
Backlog
Priority
CI Blocker
Priority
Critical
Priority
High
Priority
Low
Priority
Medium
Signed-off: Owner
Signed-off: Scrum Master
Signed-off: Tech Lead
Spike
State
Completed
State
Duplicate
State
In Progress
State
In Review
State
Paused
State
Unverified
State
Verified
State
Wont Do
Type
Automation
Type
Bug
Type
Discussion
Type
Documentation
Type
Epic
Type
Feature
Type
Legendary
Type
Refactor
Type
Support
Type
Task
Type
Testing
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Depends on
#3375 test(e2e): create M7 (v3.6.0) acceptance test suite — robot/e2e/m7_acceptance.robot
cleveragents/cleveragents-core
#3376 feat(examples): implement code-review skill example with local/reviewer actor
cleveragents/cleveragents-core
#3380 TEST-INFRA: [missing-test-levels] Add Robot and ASV tests for auto_debug.py
cleveragents/cleveragents-core
#3381 TEST-INFRA: [missing-test-levels] Add Robot and ASV tests for graphs/context_analysis.py
cleveragents/cleveragents-core
#3575 test(robot): improve test data quality in database integration tests
cleveragents/cleveragents-core
#3581 test(features): improve test data quality in plan persistence BDD scenarios
cleveragents/cleveragents-core
#3618 UAT: JSON output format missing spec-required envelope structure (
command, status, exit_code, data, timing, messages)
cleveragents/cleveragents-core
#3622 TEST-INFRA: [test-data-quality] Improve fixture management for complex test data
cleveragents/cleveragents-core
#3624 TEST-INFRA: [test-data-quality] Use Scenario Outlines for data-driven tests
cleveragents/cleveragents-core
#3722 UAT: SkillService silently swallows ALL database exceptions — violates spec error-handling contract
cleveragents/cleveragents-core
#3724 UAT: SkillService.get_dependents() always returns empty actors list — spec requires actor dependency check before skill removal
cleveragents/cleveragents-core
#3731 UAT: SkillRegistryService docstrings reference non-existent exception classes DuplicateSkillError and SkillNotFoundError
cleveragents/cleveragents-core
#3733 UAT: InlineToolExecutor module docstring claims "background thread" execution but implementation uses subprocess — misleading safety contract
cleveragents/cleveragents-core
#3735 UAT: SkillService uses timezone-naive datetime.now() for created_at/updated_at timestamps — violates UTC timestamp standard
cleveragents/cleveragents-core
#3740 UAT: SkillService._schema_to_skill_dict() drops inline tool name field — anonymous tools lose their identity
cleveragents/cleveragents-core
#3841 UAT: Test coverage at 84.42% — below the required 97% minimum threshold
cleveragents/cleveragents-core
#3875 UAT:
unittest.mock used in 68 Robot Framework integration test helper files — violates integration test mock prohibition
cleveragents/cleveragents-core
#3883 UAT:
pytest, pytest-asyncio, and pytest-cov listed in [dev] dependencies — xUnit test framework should not be a project dependency
cleveragents/cleveragents-core
#3889 UAT:
robot/core_cli_commands.robot.backup — backup file committed to integration test directory violates file organization rules
cleveragents/cleveragents-core
#3915 UAT:
agents skill refresh command is implemented but absent from spec CLI synopsis
cleveragents/cleveragents-core
#3948 UAT: Multiple implemented CLI command groups are absent from
docs/specification.md CLI synopsis
cleveragents/cleveragents-core
#4015 UAT:
create_workspace_snapshot() never called during plan execution — per-decision checkpoints missing
cleveragents/cleveragents-core
#4019 UAT:
create_workspace_snapshot() diff metadata not persisted to database — lost on retrieval
cleveragents/cleveragents-core
#4041 UAT: Specification describes OpenTelemetry
TelemetryService and @trace decorator that do not exist — spec contradicts ADR-025
cleveragents/cleveragents-core
#4068 UAT:
agents plan rollback accepts missing CHECKPOINT_ID — spec requires it as a mandatory positional argument
cleveragents/cleveragents-core
#4073 UAT:
agents repo index and agents repo status CLI commands exist in code but are absent from the specification's CLI synopsis
cleveragents/cleveragents-core
#4113 UAT:
agents resource add output format missing spec-required panels — shows one-liner instead of Resource, Auto-discovered Children, and Capabilities panels
cleveragents/cleveragents-core
#4117 UAT:
agents validation attach output missing spec-required "Validation Attached" panel with Attachment ID, Mode, Resource, and Scope fields
cleveragents/cleveragents-core
#4119 UAT:
agents project create output missing spec-required Linked Resources table and Defaults panel
cleveragents/cleveragents-core
#4128 UAT:
agents plan use output uses generic plan details panel instead of spec-required multi-panel output (Plan Created, Inputs, Actors, Automation, Context, Next Steps)
cleveragents/cleveragents-core
#4129 UAT:
agents plan execute output uses generic plan details panel instead of spec-required execution panels (Execution, Sandbox, Strategy Summary, Progress)
cleveragents/cleveragents-core
#4134 UAT:
agents plan status output uses generic plan details panel instead of spec-required multi-panel output (Plan Status, Progress, Timing, Execution Detail, Cost)
cleveragents/cleveragents-core
#4141 UAT:
agents session tell uses stub actor dispatch — LLM is never invoked, response is always a hardcoded echo
cleveragents/cleveragents-core
#4144 UAT: Plan estimation uses
EstimationStubActor — real actor registry dispatch is never invoked for cost estimation
cleveragents/cleveragents-core
#4413 TEST-INFRA: [missing-test-levels] Add Behave, Robot, and ASV tests for the
acp module
cleveragents/cleveragents-core
#4437 TEST-INFRA: [missing-test-levels] Add Robot and ASV tests for the
application module
cleveragents/cleveragents-core
#4467 TEST-INFRA: [missing-test-levels] Add Behave, Robot, and ASV tests for the
platform module
cleveragents/cleveragents-core
Reference
cleveragents/cleveragents-core#3374
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Metadata
feat/v3.6.0/e2e-tests-code-reviewBackground and Context
The v3.6.0 milestone scope includes "E2E workflow specification tests" and "Code review tool examples."
Issue #3328 identified that
robot/e2e/m7_acceptance.robotis missing — M1, M2, M5, and M6 all have acceptance tests but M7 (v3.6.0) does not. The specification also describes code review as a key use case, with alocal/revieweractor andcode-reviewskill as examples.This Epic groups all work required to:
Child Issues
Definition of Done
robot/e2e/m7_acceptance.robotexists and passesAutomated by CleverAgents Bot
Supervisor: Unknown | Agent: ca-epic-planner
Child Issues Created
The following child issues have been created for this Epic:
All child issues block this Epic via Forgejo dependency links.
Dependency Chain:
Automated by CleverAgents Bot
Supervisor: Unknown | Agent: ca-epic-planner
Issue triaged by project owner:
Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: ca-project-owner
command,status,exit_code,data,timing,messages) #3618command,status,exit_code,data,timing,messages)unittest.mockused in 68 Robot Framework integration test helper files — violates integration test mock prohibition #3875unittest.mockused in 68 Robot Framework integration test helper files — violates integration test mock prohibitionpytest,pytest-asyncio, andpytest-covlisted in[dev]dependencies — xUnit test framework should not be a project dependency #3883pytest,pytest-asyncio, andpytest-covlisted in[dev]dependencies — xUnit test framework should not be a project dependencyrobot/core_cli_commands.robot.backup— backup file committed to integration test directory violates file organization rules #3889robot/core_cli_commands.robot.backup— backup file committed to integration test directory violates file organization rulesagents skill refreshcommand is implemented but absent from spec CLI synopsis #3915agents skill refreshcommand is implemented but absent from spec CLI synopsisdocs/specification.mdCLI synopsis #3948docs/specification.mdCLI synopsiscreate_workspace_snapshot()never called during plan execution — per-decision checkpoints missing #4015create_workspace_snapshot()never called during plan execution — per-decision checkpoints missingcreate_workspace_snapshot()diff metadata not persisted to database — lost on retrieval #4019create_workspace_snapshot()diff metadata not persisted to database — lost on retrievalTelemetryServiceand@tracedecorator that do not exist — spec contradicts ADR-025 #4041TelemetryServiceand@tracedecorator that do not exist — spec contradicts ADR-025agents plan rollbackaccepts missing CHECKPOINT_ID — spec requires it as a mandatory positional argument #4068agents plan rollbackaccepts missing CHECKPOINT_ID — spec requires it as a mandatory positional argumentagents repo indexandagents repo statusCLI commands exist in code but are absent from the specification's CLI synopsis #4073agents repo indexandagents repo statusCLI commands exist in code but are absent from the specification's CLI synopsisagents resource addoutput format missing spec-required panels — shows one-liner instead of Resource, Auto-discovered Children, and Capabilities panels #4113agents resource addoutput format missing spec-required panels — shows one-liner instead of Resource, Auto-discovered Children, and Capabilities panelsagents validation attachoutput missing spec-required "Validation Attached" panel with Attachment ID, Mode, Resource, and Scope fields #4117agents project createoutput missing spec-required Linked Resources table and Defaults panel #4119agents validation attachoutput missing spec-required "Validation Attached" panel with Attachment ID, Mode, Resource, and Scope fieldsagents project createoutput missing spec-required Linked Resources table and Defaults panelagents plan useoutput uses generic plan details panel instead of spec-required multi-panel output (Plan Created, Inputs, Actors, Automation, Context, Next Steps) #4128agents plan useoutput uses generic plan details panel instead of spec-required multi-panel output (Plan Created, Inputs, Actors, Automation, Context, Next Steps)agents plan executeoutput uses generic plan details panel instead of spec-required execution panels (Execution, Sandbox, Strategy Summary, Progress) #4129agents plan executeoutput uses generic plan details panel instead of spec-required execution panels (Execution, Sandbox, Strategy Summary, Progress)agents plan statusoutput uses generic plan details panel instead of spec-required multi-panel output (Plan Status, Progress, Timing, Execution Detail, Cost) #4134agents plan statusoutput uses generic plan details panel instead of spec-required multi-panel output (Plan Status, Progress, Timing, Execution Detail, Cost)agents session telluses stub actor dispatch — LLM is never invoked, response is always a hardcoded echo #4141agents session telluses stub actor dispatch — LLM is never invoked, response is always a hardcoded echoEstimationStubActor— real actor registry dispatch is never invoked for cost estimation #4144EstimationStubActor— real actor registry dispatch is never invoked for cost estimationacpmodule #4413acpmoduleapplicationmodule #4437applicationmoduleplatformmodule #4467platformmodulejq -r '.plan_id'butplan use --format jsonwraps output in envelope — correct path is.data.plan_id#4613jq -r '.plan_id'butplan use --format jsonwraps output in envelope — correct path is.data.plan_id