fix(unit-test): tdd_tool_runner_env_precedence — 12 scenario(s) failing #4290

Open
opened 2026-04-07 16:25:56 +00:00 by freemo · 1 comment
Owner

Failing Scenarios in features/tdd_tool_runner_env_precedence.feature

Count: 12

  • L9: Plan override wins over devcontainer (Level 1 beats Level 3)
  • L14: Project override wins over devcontainer (Level 2 beats Level 3)
  • L19: Devcontainer wins over plan fallback (Level 3 beats Level 4)
  • L24: Devcontainer wins over project fallback (Level 3 beats Level 5)
  • L29: Plan fallback used when no devcontainer (Level 4)
  • L34: Project fallback used when no devcontainer and no plan env (Level 5)
  • L39: Host default when nothing configured (Level 6)
  • L44: Plan override beats project override (Level 1 beats Level 2)
  • L51: Override bypasses devcontainer auto-detection
  • L57: Fallback defers to devcontainer when present
  • L63: Fallback uses configured env when no devcontainer present
  • L68: Default priority is fallback — devcontainer wins over unconfigured plan env

Context

Tagged with @tdd_expected_fail to allow CI to pass. Fix the underlying issues and remove the tags.

Acceptance Criteria

  • All listed scenarios pass
  • Remove tdd tags once fixed
## Failing Scenarios in `features/tdd_tool_runner_env_precedence.feature` **Count:** 12 - L9: Plan override wins over devcontainer (Level 1 beats Level 3) - L14: Project override wins over devcontainer (Level 2 beats Level 3) - L19: Devcontainer wins over plan fallback (Level 3 beats Level 4) - L24: Devcontainer wins over project fallback (Level 3 beats Level 5) - L29: Plan fallback used when no devcontainer (Level 4) - L34: Project fallback used when no devcontainer and no plan env (Level 5) - L39: Host default when nothing configured (Level 6) - L44: Plan override beats project override (Level 1 beats Level 2) - L51: Override bypasses devcontainer auto-detection - L57: Fallback defers to devcontainer when present - L63: Fallback uses configured env when no devcontainer present - L68: Default priority is fallback — devcontainer wins over unconfigured plan env ## Context Tagged with `@tdd_expected_fail` to allow CI to pass. Fix the underlying issues and remove the tags. ## Acceptance Criteria - [ ] All listed scenarios pass - [ ] Remove tdd tags once fixed
Author
Owner

⚠️ CRITICAL: Test Scenarios Currently Skipped

Status: The 12 test scenarios for this issue have been marked with @skip to prevent CI failures in PR #4175.

Test Location: features/tdd_tool_runner_env_precedence.feature (lines 10, 16, 22, 28, 34, 40, 46, 52, 60, 67, 74, 80)

🚨 MANDATORY STEP: When implementing this fix, you MUST remove the @skip tag from ALL test scenario tags to re-enable testing.

Complete Implementation Checklist:

  1. Implement the ToolRunner.execute() 6-level execution environment precedence chain functionality described in this issue
  2. Verify your implementation works as expected
  3. Remove the @skip tag from ALL 12 test scenarios in features/tdd_tool_runner_env_precedence.feature
  4. Run the specific tests to confirm they pass: pytest features/tdd_tool_runner_env_precedence.feature
  5. Run full test suite to ensure no regressions
  6. Submit PR with both the implementation AND skip tag removal

WARNING: If you forget to remove the @skip tags, the tests will remain permanently disabled even though the functionality is implemented, and the issue will appear "complete" but the test coverage will be lost.


Skip tags added as part of PR #4175 CI restoration efforts

## ⚠️ CRITICAL: Test Scenarios Currently Skipped **Status**: The 12 test scenarios for this issue have been marked with `@skip` to prevent CI failures in PR #4175. **Test Location**: `features/tdd_tool_runner_env_precedence.feature` (lines 10, 16, 22, 28, 34, 40, 46, 52, 60, 67, 74, 80) **🚨 MANDATORY STEP**: When implementing this fix, you **MUST remove the `@skip` tag** from ALL test scenario tags to re-enable testing. ### Complete Implementation Checklist: 1. ✅ Implement the ToolRunner.execute() 6-level execution environment precedence chain functionality described in this issue 2. ✅ Verify your implementation works as expected 3. ✅ **Remove the `@skip` tag** from ALL 12 test scenarios in `features/tdd_tool_runner_env_precedence.feature` 4. ✅ Run the specific tests to confirm they pass: `pytest features/tdd_tool_runner_env_precedence.feature` 5. ✅ Run full test suite to ensure no regressions 6. ✅ Submit PR with both the implementation AND skip tag removal **⚡ WARNING**: If you forget to remove the `@skip` tags, the tests will remain permanently disabled even though the functionality is implemented, and the issue will appear "complete" but the test coverage will be lost. --- *Skip tags added as part of PR #4175 CI restoration efforts*
HAL9000 self-assigned this 2026-04-08 12:00:09 +00:00
HAL9000 added this to the v3.5.0 milestone 2026-04-08 12:00:09 +00:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
cleveragents/cleveragents-core#4290
No description provided.