Files
cleveragents-core/robot
freemo cd06fe58f6 test(e2e): workflow example 2 — automated test generation for a module (trusted profile)
E2E Robot Framework test for WF02: Automated Test Generation using the
trusted automation profile.  Exercises the full plan lifecycle (action
create, resource add, project create, validation add/attach, plan
use/execute/artifacts/diff/apply) against a temporary repository with
a low-coverage auth module.

Key design decisions:
- Registers coverage validation (pytest --cov=src/auth --cov-fail-under=80)
  and attaches it to the project, per spec WF02 Step 1.
- Verifies plan artifacts listing after execute (spec §36971).
- Verifies coverage improvement after apply — checks apply output for
  validation results, falls back to running pytest --cov directly.
- All LLM-dependent commands use expected_rc=None for flexible assertions.
- Plan ID extraction uses Safe Parse Json Field from common_e2e.resource
  (eliminates duplicated Extract Plan Id keyword).
- Invariant check uses regex matching any src/ path in diff output (not
  just src/auth.py), and fails hard on violation (not just warn).
- Post-apply verification detects both new test files and modifications
  to existing files; handles zero-artifact LLM responses gracefully.
- Commit Fixture Files checks git return codes consistently with
  common_e2e.resource patterns.
- Traceback/INTERNAL checks on all plan execute and apply outputs.
- Skip If No LLM Keys guard for graceful CI degradation.
- Actor selection based on available API key (Anthropic/OpenAI).
- CHANGELOG.md updated per CONTRIBUTING.md requirements.

ISSUES CLOSED: #748
2026-03-27 09:59:47 +00:00
..