Files
cleveragents-core/features/plan_cli_coverage_r3.feature
T
freemo 02250473ad fix(ci): restore all CI quality gates to passing on master
Fix all failing CI quality gates (lint, unit_tests, format) without
suppressing any quality enforcement.

Root causes and fixes:

1. Format: features/steps/plan_namespaced_name_tdd_steps.py had trailing
   whitespace; fixed by running ruff format.

2. Unit tests - A2A JSON-RPC 2.0 migration (commit 9c6d6915) renamed
   A2aRequest fields (operation→method, request_id→id, a2a_version→jsonrpc)
   and A2aResponse fields (status+data→result, request_id→id) but did not
   update all step files and feature files:
   - a2a_jsonrpc_wire_format_steps.py: added use_step_matcher('re') and
     reset to 'parse' at end to prevent parallel test interference
   - a2a_facade_wiring_steps.py: updated operation= to method=, .status/.data
     to .result
   - a2a_facade_steps.py: updated request_id→id, a2a_version→jsonrpc,
     A2aResponse(request_id=..., status=...) to new API
   - m6_facade_steps.py: updated all old API usage
   - devcontainer_cleanup_steps.py: updated A2aRequest(operation=...)
   - plan_prompt_command_steps.py: updated A2aRequest(operation=...)
   - wf03_plan_prompt_confidence_steps.py: updated A2aRequest(operation=...)
   - consolidated_misc.feature: updated old A2aRequest/A2aResponse scenarios

3. Unit tests - Session CLI output changed (commit 0d5d9cf0 and others):
   - 'Session Created' → 'Session created' (lowercase)
   - 'Session Details' → 'Session Summary'
   - 'Sessions (N total)' → 'Sessions'
   - session list JSON: top-level 'total' → nested 'summary.total'
   - Fixed in: session_cli.feature, session_cli_coverage_boost.feature,
     session_cli_uncovered_branches.feature, session_list_error.feature,
     tdd_session_create_persist_steps.py

4. Unit tests - Plan list output changed (commit 1a07a891):
   - 'V3 Lifecycle Plans' → 'Plans'
   - 'Lifecycle Plans' → 'Plans'
   - Name column removed (restored in source)
   - Invariants column removed (restored in source)
   - Project truncation removed (restored in source)
   - Fixed in: plan_cli_cancel_revert_coverage.feature,
     plan_lifecycle_cli_coverage.feature, plan_cli_coverage_boost_steps.py,
     plan.py (source code restored)

5. Unit tests - Plan apply command now requires ULID (commit 300a5d6d):
   - plan_cli_coverage_r3.feature: updated 'PLAN-001' to valid ULID
   - plan_cli_coverage_r3_steps.py: added --yes flag, added new step for
     no-eligible-plans path

6. Unit tests - Various source code bugs:
   - ThoughtBlock: converted from @dataclass to Pydantic BaseModel
     (architecture test requires all dataclasses to use Pydantic)
   - session.py: added DatabaseError handling to export, import, tell commands
   - database.py: fixed rollback_to() to reuse checkpoint connection for writes
   - database.py: added _get_checkpoint_conn() helper
   - check-tls-cert.py: fixed SSLCertVerificationError.reason AttributeError

7. Unit tests - Test step bugs:
   - error_recovery_coverage_boost_steps.py: fixed invalid ULID _PLAN_ID
   - session_service_coverage_steps.py: fixed 'sha256:' prefix bug in checksum
   - database_models_new_coverage_steps.py: added 'name' field to session mock
   - async_audit_recording_steps.py: fixed Settings(audit_async=False) via env var
   - coverage_threshold_config_steps.py: added --coverage-min pattern support
   - m5_acms_smoke_steps.py: updated usage hint text
   - actor_cli_yaml_steps.py: updated 'Removed actor' → 'Actor removed'
   - aimodelscredentials_steps.py: set context.imported_class in import step
   - domain_base_model.feature: added missing 'When I examine model_config' step
   - tui_first_run_steps.py: fixed module reload to restore cleveragents.tui.*
     modules after test (prevented patch interference in subsequent tests)
   - tui_first_run_steps.py: added set_search('') step for empty string
   - resource_handler_base_coverage_r3_steps.py: use _MinimalHandler instead
     of DatabaseResourceHandler for NotImplementedError tests
   - resource_handler_crud.feature: updated to test new DatabaseHandler behavior
   - resource_handler_sandbox.feature: updated to test new DatabaseHandler behavior
   - tdd_json_decode_crash_persistence.feature: fixed @tdd_bug → @tdd_issue tags

8. Parallel test interference:
   - All step files using use_step_matcher('re') now reset to 'parse' at end
     to prevent global matcher state leaking to subsequent step files
2026-04-04 20:38:16 +00:00

118 lines
5.4 KiB
Gherkin

@mock_only
Feature: Plan CLI coverage round 3
Exercise uncovered lines in cleveragents/cli/commands/plan.py that are
not yet hit by existing test suites. Each scenario uses the "plcov3"
step prefix to avoid Behave AmbiguousStep collisions.
# validate_namespaced_actor (lines 104, 107-108)
Scenario: validate_namespaced_actor rejects invalid actor name
Given a plcov3 CLI runner
When I plcov3 call validate_namespaced_actor with value "BAD_NAME" and flag "--strategy-actor"
Then the plcov3 error should be a ValidationError with message containing "namespace/name"
Scenario: validate_namespaced_actor accepts valid actor name
Given a plcov3 CLI runner
When I plcov3 call validate_namespaced_actor with value "openai/gpt-4" and flag "--strategy-actor"
Then the plcov3 result should equal "openai/gpt-4"
# ── _plan_spec_dict with execution_environment (line 184) ───────
Scenario: _plan_spec_dict includes execution_environment when set
Given a plcov3 CLI runner
And a plcov3 v3 plan with execution_environment "container"
When I plcov3 call _plan_spec_dict
Then the plcov3 spec dict should contain key "execution_environment" with value "container"
# ── build command PlanError handler (line 790) ──────────────────
Scenario: build command handles PlanError
Given a plcov3 CLI runner
And a plcov3 mocked build environment that raises PlanError
When I plcov3 invoke the build command
Then the plcov3 CLI output should contain "Build Error"
# ── apply command v3 path with plan_id (lines 799-824) ─────────
Scenario: apply command with plan_id delegates to v3 lifecycle
Given a plcov3 CLI runner
And a plcov3 mocked lifecycle service for apply happy path
When I plcov3 invoke apply with plan_id "01ARZ3NDEKTSV4RRFFQ69G5FAA"
Then the plcov3 CLI exit code should be 0
# ── apply command no eligible plans path ─────────────────────────
Scenario: apply command legacy path with pending changes
Given a plcov3 CLI runner
And a plcov3 mocked lifecycle service with no eligible apply plans
When I plcov3 invoke apply without plan_id
Then the plcov3 CLI output should contain "No plans ready for apply"
Scenario: apply command legacy path with no pending changes
Given a plcov3 CLI runner
And a plcov3 mocked lifecycle service with no eligible apply plans
When I plcov3 invoke apply without plan_id
Then the plcov3 CLI output should contain "No plans ready for apply"
# ── continue_plan command (lines 1205-1224) ─────────────────────
Scenario: continue command with prompt
Given a plcov3 CLI runner
And a plcov3 mocked continue environment
When I plcov3 invoke continue with prompt "add caching"
Then the plcov3 CLI output should contain "Added instructions"
Scenario: continue command without prompt shows current plan
Given a plcov3 CLI runner
And a plcov3 mocked continue environment with current plan
When I plcov3 invoke continue without prompt
Then the plcov3 CLI output should contain "Continuing with plan"
# ── use_action with strategy_actor (lines 1529-1542, 1631-1633, 1751-1752) ─
Scenario: use command with strategy-actor override
Given a plcov3 CLI runner
And a plcov3 mocked use_action environment
When I plcov3 invoke use with action "local/test" and strategy-actor "openai/gpt-4"
Then the plcov3 CLI exit code should be 0
# ── use_action with execution_env_priority valid (lines 1789-1792) ──
Scenario: use command with valid execution-env-priority
Given a plcov3 CLI runner
And a plcov3 mocked use_action environment
When I plcov3 invoke use with action "local/test" and execution-environment "host" and priority "fallback"
Then the plcov3 CLI exit code should be 0
# ── use_action with invalid execution_env_priority (line 1794) ──
Scenario: use command with invalid execution-env-priority
Given a plcov3 CLI runner
And a plcov3 mocked use_action environment
When I plcov3 invoke use with action "local/test" and execution-environment "host" and priority "INVALID"
Then the plcov3 CLI output should contain "Invalid execution env priority"
# ── plan diff command (lines 2740-2741, 2743) ──────────────────
Scenario: diff command invokes apply service
Given a plcov3 CLI runner
And a plcov3 mocked apply service for diff
When I plcov3 invoke diff with plan_id "PLAN-001"
Then the plcov3 CLI exit code should be 0
# ── correct_decision ValidationError handler (lines 3047-3048) ──
Scenario: correct command handles ValidationError
Given a plcov3 CLI runner
And a plcov3 mocked correction environment that raises ValidationError
When I plcov3 invoke correct with identifier "DEC-001" mode "revert" guidance "fix it"
Then the plcov3 CLI output should contain "Validation Error"
# ── correct_decision CleverAgentsError handler (line 3051) ──────
Scenario: correct command handles CleverAgentsError
Given a plcov3 CLI runner
And a plcov3 mocked correction environment that raises CleverAgentsError
When I plcov3 invoke correct with identifier "DEC-001" mode "revert" guidance "fix it"
Then the plcov3 CLI output should contain "Error"