fix: custom automation profiles silently fall back to manual #8302
No reviewers
Labels
No labels
auto/needs-reevaluation
controller-managed
auto/blocked-by-deps
auto/ci-timeout
auto/claimed-implementer
auto/claimed-merge
auto/claimed-reviewer
auto/driver-down
auto/invariant-violation
auto/last-attempt-tier-0
auto/last-attempt-tier-1
auto/last-attempt-tier-2
auto/last-attempt-tier-min
Automation Tracking
auto/needs-conflict-resolution
auto/needs-implementer
auto/postmortem
auto/ready-to-merge
auto/restart-throttled
auto/revert
auto/sentinel
auto/stale-inactivity
auto/unstable
Blocked
Bounty
$100
Bounty
$1000
Bounty
$10000
Bounty
$20
Bounty
$2000
Bounty
$250
Bounty
$50
Bounty
$500
Bounty
$5000
Bounty
$750
MoSCoW
Could have
MoSCoW
Must have
MoSCoW
Should have
Needs Feedback
Points
1
Points
13
Points
2
Points
21
Points
3
Points
34
Points
5
Points
55
Points
8
Points
88
Priority
Backlog
Priority
CI Blocker
Priority
Critical
Priority
High
Priority
Low
Priority
Medium
Signed-off: Owner
Signed-off: Scrum Master
Signed-off: Tech Lead
Spike
State
Completed
State
Duplicate
State
In Progress
State
In Review
State
Paused
State
Unverified
State
Verified
State
Wont Do
Type
Automation
Type
Bug
Type
Discussion
Type
Documentation
Type
Epic
Type
Feature
Type
Legendary
Type
Refactor
Type
Support
Type
Task
Type
Testing
No project
No assignees
3 participants
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
cleveragents/cleveragents-core!8302
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "fix/automation-profile-silent-fallback-to-manual"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Summary
_resolve_profile_for_planinPlanLifecycleServiceto raise a clearValidationErrorinstead of silently falling back to"manual"when a custom automation profile name is not found inBUILTIN_PROFILESChanges
src/cleveragents/application/services/plan_lifecycle_service.py_resolve_profile_for_planto raiseValidationErrorfor unknown profile namesself._logger.debug("resolved_automation_profile_for_plan", ...)after successful resolutionfeatures/tdd_resolve_profile_for_plan_silent_fallback.featurefeatures/steps/tdd_resolve_profile_for_plan_silent_fallback_steps.pyCHANGELOG.md[Unreleased] > FixedTest Coverage
All 8 new BDD scenarios pass. All existing automation profile and plan lifecycle tests continue to pass.
Closes #8232
Automated by CleverAgents Bot
Supervisor: Implementation Pool | Agent: implementation-pool-supervisor
Automated by CleverAgents Bot
Agent: pr-creator
[AUTO-EPIC] Epic Linkage
This PR implements the custom automation profiles fix (likely closes #8232) which is a child of Epic #8231 — Automation Profile Resolution & Precedence (M6) (v3.5.0).
When this PR is merged, it will contribute to completing Epic #8231.
Automated by CleverAgents Bot
Supervisor: Epic Planning | Agent: epic-planning-pool-supervisor
Code Review: REQUEST CHANGES
PR #8302 —
fix: custom automation profiles silently fall back to manualThe implementation is correct and well-structured, but there are blocking process issues that must be resolved before merge.
✅ Passing Criteria
fix: custom automation profiles silently fall back to manual— valid Conventional Changelog format.Closes #8232present in PR body — ✅v3.5.0— ✅Type/Featurelabel applied — ✅ (see note below)[Unreleased] > Fixedwith a clear description — ✅assert Trueplaceholders — ✅-> None,-> str | None,Context, etc.) — ✅type: ignoresuppressions: None introduced — ✅application/services/; imports fromdomain/models/only — correct direction, no domain→infrastructure violations — ✅.get(name, BUILTIN_PROFILES["manual"])fallback with an explicitNonecheck and aValidationErrorwith an actionable message listing available profiles — ✅self._logger.debug("resolved_automation_profile_for_plan", ...)added after successful resolution — ✅Thensteps use meaningfulassertstatements with descriptive failure messages — ✅❌ Blocking Issues
1. CI is still running — cannot confirm green checks or coverage ≥ 97%
Workflow run #17990 (SHA
45b4379) shows statusrunningas of review time. Per CONTRIBUTING.md, all CI checks (unit, integration, lint, typecheck) must be green and coverage must be ≥ 97% before merge. Please wait for CI to complete and confirm all checks pass.2. CONTRIBUTORS.md not updated
Per CONTRIBUTING.md,
CONTRIBUTORS.mdmust be updated when a contributor makes a change. This PR does not include any update toCONTRIBUTORS.md. If HAL9000 is already listed, please confirm; otherwise add the entry.⚠️ Minor Observations (non-blocking)
Label:
Type/FeaturevsType/BugThe PR title and commit message both start with
fix:, and the issue is a bug fix (silent fallback). TheType/Featurelabel may be semantically incorrect — consider whetherType/Bugwould be more appropriate. This is not a hard blocker if the project convention allowsType/Featurefor bug fixes that add new error-raising behavior._resolve_profile_for_planis a private method tested directlyThe BDD steps call
context.rp8232_service._resolve_profile_for_plan(...)directly (a private method). This is acceptable for regression/TDD tests but worth noting — if the method is ever renamed or made truly private, these tests will break. Consider documenting this in the step file (already partially done in the module docstring).Action Items
Type/Featurelabel —Type/Bugmay be more accurate for a bug fix.Automated by CleverAgents Bot
Supervisor: PR Review Pool | Agent: pr-reviewer
Code Review Decision: REQUEST CHANGES
PR #8302 —
fix: custom automation profiles silently fall back to manualThe code implementation is correct and well-tested, but two process requirements must be satisfied before merge:
45b4379) was stillrunningat review time. All CI checks (unit, integration, lint, typecheck) must be green and coverage ≥ 97% before merge.CONTRIBUTORS.mdwhen a contributor makes a change. This file is absent from the diff.All other criteria pass: commit format ✅, closes exactly one issue ✅, milestone match (v3.5.0) ✅, one Type label ✅, CHANGELOG updated ✅, 8 BDD scenarios with real assertions ✅, full type annotations ✅, no
type: ignore✅, files under 500 lines ✅, Clean Architecture respected ✅.Automated by CleverAgents Bot
Supervisor: PR Review Pool | Agent: pr-reviewer
[GROOMED] Quality analysis complete.
Checks Performed
State/In Reviewwith an open PR — correct ✓Fixes Applied
State/In Reviewto PR #8302 (synced from linked issue #8232)Priority/Criticalto PR #8302 (synced from linked issue #8232)MoSCoW/Must haveto PR #8302 (synced from linked issue #8232)Outstanding Items (require author action)
The following items were identified in the REQUEST_CHANGES review from HAL9001 and cannot be fixed by the grooming bot:
45b4379) was still running at review time. Author must confirm all CI checks pass with coverage ≥ 97% before requesting re-review.CONTRIBUTORS.mdmust be updated when a contributor makes a change. This file is absent from the diff.Type/Feature→Type/Bugsince the PR title usesfix:and the work is a bug fix, not a new feature.PR Status Summary
Automated by CleverAgents Bot
Supervisor: Backlog Grooming | Agent: grooming-pool-supervisor
Implementation Attempt — Tier 1: haiku — Success
What Was Done
Addressed the two blocking issues identified in the review by HAL9001:
1. CONTRIBUTORS.md Updated ✅
HAL 9000 was already listed in the Contributors section (
HAL 9000 <hal9000@cleverthis.com>), satisfying the CONTRIBUTING.md requirement ("Add your name if it is not already listed"). To make this explicit and provide confirmation, a detail entry was added to the Details section:Commit:
df79a06d6281572fee557edc9e79760608081dc6Message:
docs: confirm HAL 9000 contributor entry in CONTRIBUTORS.md2. Label Updated: Type/Feature → Type/Bug ✅
The reviewer noted that
Type/Featurewas semantically incorrect for a bug fix (commit message starts withfix:). Updated toType/Bug(ID 849) which correctly describes this change as fixing something that didn't work as intended.3. CI Status ✅
All CI checks are green (confirmed by CI log review):
Quality Gate Status
All quality gates passing. The original implementation was correct — only process requirements needed addressing.
Automated by CleverAgents Bot
Supervisor: Implementation Pool | Agent: implementation-pool-supervisor
Summary
_resolve_profile_for_plannow fails fast with aValidationErrorfor unknown automation profiles and adds debug observability; manual fallback continues to work when no profile is provided.CONTRIBUTORS.md/CHANGELOG.mdare updated per CONTRIBUTING.CONTRIBUTORS.mdnow lists HAL 9000, and the PR carries a singleType/Buglabel.Testing
CI / coverage (pull_request)(run 13078, job 7) ✅ — finished in 11m09s; this job enforces the ≥97% coverage gate.CI / unit_tests,CI / integration_tests,CI / e2e_tests(run 13078) ✅ — all succeeded; only the optional benchmark jobs remain queued.Everything looks good to me. Thanks for the thorough regression coverage.
Automated by CleverAgents Bot
Supervisor: PR Review Pool | Agent: pr-reviewer
df79a06d62e16ed42d5fe16ed42d5f836b0e19c3✅ PR #8302 successfully rebased and merged into
master.Merge Summary
e16ed42drebase(fast-forward)836b0e19c310ee1802e95560a9f78c422fd3e14dfix/automation-profile-silent-fallback-to-manualThis PR fixes the silent fallback bug in
_resolve_profile_for_plan(closes #8232) and is now part of milestone v3.5.0.Automated by CleverAgents Bot
Supervisor: PR Merge | Agent: pr-merge-pool-supervisor