test(e2e): verify M6 success criteria — Firefox-scale autonomous porting #457

Merged
brent.edwards merged 4 commits from test/m6-e2e-verification into master 2026-02-27 23:00:15 +00:00

4 Commits

Author SHA1 Message Date
brent.edwards ea060ec7a9 Merge branch 'master' into test/m6-e2e-verification
CI / lint (pull_request) Successful in 14s
CI / benchmark-publish (pull_request) Has been skipped
CI / quality (pull_request) Successful in 19s
CI / security (pull_request) Successful in 32s
CI / typecheck (pull_request) Successful in 33s
CI / build (pull_request) Successful in 26s
CI / integration_tests (pull_request) Successful in 5m24s
CI / benchmark-regression (pull_request) Successful in 25m29s
CI / unit_tests (pull_request) Successful in 33m25s
CI / docker (pull_request) Successful in 14s
CI / coverage (pull_request) Successful in 42m43s
2026-02-27 22:16:51 +00:00
brent.edwards 78bd3584e0 Merge branch 'master' into test/m6-e2e-verification
CI / lint (pull_request) Successful in 20s
CI / benchmark-publish (pull_request) Has been skipped
CI / typecheck (pull_request) Successful in 38s
CI / quality (pull_request) Successful in 37s
CI / security (pull_request) Successful in 52s
CI / build (pull_request) Successful in 35s
CI / integration_tests (pull_request) Successful in 5m16s
CI / benchmark-regression (pull_request) Successful in 27m54s
CI / unit_tests (pull_request) Successful in 33m2s
CI / docker (pull_request) Successful in 55s
CI / coverage (pull_request) Successful in 53m19s
2026-02-27 20:03:33 +00:00
brent.edwards f7b8186b3f Merge branch 'master' into test/m6-e2e-verification
CI / lint (pull_request) Successful in 25s
CI / quality (pull_request) Successful in 21s
CI / security (pull_request) Successful in 32s
CI / benchmark-publish (pull_request) Has been skipped
CI / typecheck (pull_request) Successful in 50s
CI / build (pull_request) Successful in 22s
CI / integration_tests (pull_request) Successful in 5m18s
CI / unit_tests (pull_request) Successful in 12m10s
CI / docker (pull_request) Successful in 39s
CI / benchmark-regression (pull_request) Successful in 25m18s
CI / coverage (pull_request) Successful in 1h16m20s
2026-02-26 21:26:00 +00:00
brent.edwards 1ec2200e34 test(e2e): verify M6 success criteria — Firefox-scale autonomous porting
CI / benchmark-publish (pull_request) Has been skipped
CI / lint (pull_request) Successful in 15s
CI / build (pull_request) Successful in 16s
CI / quality (pull_request) Successful in 19s
CI / security (pull_request) Successful in 30s
CI / typecheck (pull_request) Successful in 34s
CI / integration_tests (pull_request) Successful in 4m18s
CI / unit_tests (pull_request) Successful in 12m21s
CI / docker (pull_request) Successful in 15s
CI / benchmark-regression (pull_request) Successful in 25m32s
CI / coverage (pull_request) Successful in 40m18s
Robot Framework E2E test suite exercising the complete M6 success
criteria verification sequence:

- Porting action creation from YAML config via CLI
- Plan use + execute via CLI with mocked lifecycle service
- Hierarchical decomposition: 4+ levels (root + L1-L4 = 21+ plans)
- Decision correction recomputes only affected subtree (CorrectionImpact)
- Parallel execution scales to 15 concurrent subplans (10+ required)
- Realistic porting task: full ACTION → STRATEGIZE → EXECUTE → APPLY
  lifecycle with 10 subplans completing autonomously
- Plan apply transitions to APPLIED terminal state
- SubplanFailureHandler retry/stop-others logic verification
- SubplanConfig supports all execution modes and merge strategies
- Decision tree structure: PROMPT_DEFINITION root with
  SUBPLAN_PARALLEL_SPAWN children and superseded_by flow

Ten subcommands in the Python helper, each printing a sentinel
string on success. All subcommands verified passing locally.

Closes #407
2026-02-26 19:27:53 +00:00