brent.edwards
af212bc432
CI / benchmark-publish (pull_request) Has been skipped
CI / build (pull_request) Successful in 16s
CI / quality (pull_request) Successful in 17s
CI / lint (pull_request) Successful in 19s
CI / typecheck (pull_request) Successful in 36s
CI / security (pull_request) Successful in 42s
CI / integration_tests (pull_request) Successful in 4m27s
CI / unit_tests (pull_request) Successful in 12m9s
CI / docker (pull_request) Successful in 1m2s
CI / benchmark-regression (pull_request) Successful in 23m38s
CI / coverage (pull_request) Successful in 48m6s
Add Robot Framework end-to-end test suite that verifies the complete M1 success criteria: action creation from YAML, git resource registration, project creation and resource linking, plan use/execute/diff/apply lifecycle, SQLite persistence, ChangeSet from tool invocations, git worktree sandbox isolation, and post-apply commit verification.
74 lines
3.6 KiB
Plaintext
74 lines
3.6 KiB
Plaintext
*** Settings ***
|
|
Documentation M1 end-to-end verification: action creation, resource registration, project linking, plan lifecycle, SQLite persistence, ChangeSet from tool invocations, git worktree sandbox isolation, and post-apply commit
|
|
Resource ${CURDIR}/common.resource
|
|
Suite Setup Setup Test Environment
|
|
Suite Teardown Cleanup Test Environment
|
|
|
|
*** Variables ***
|
|
${HELPER} ${CURDIR}/helper_m1_e2e_verification.py
|
|
|
|
*** Test Cases ***
|
|
Action Create From YAML Config
|
|
[Documentation] Create an action from a YAML config file via agents action create --config
|
|
${result}= Run Process ${PYTHON} ${HELPER} action-create cwd=${WORKSPACE}
|
|
Log ${result.stdout}
|
|
Log ${result.stderr}
|
|
Should Be Equal As Integers ${result.rc} 0
|
|
Should Contain ${result.stdout} m1-action-create-ok
|
|
|
|
Register Git Checkout Resource
|
|
[Documentation] Register a git-checkout resource via agents resource add
|
|
${result}= Run Process ${PYTHON} ${HELPER} resource-register cwd=${WORKSPACE}
|
|
Log ${result.stdout}
|
|
Log ${result.stderr}
|
|
Should Be Equal As Integers ${result.rc} 0
|
|
Should Contain ${result.stdout} m1-resource-register-ok
|
|
|
|
Create Project And Link Resource
|
|
[Documentation] Create a project and link a resource to it
|
|
${result}= Run Process ${PYTHON} ${HELPER} project-create-link cwd=${WORKSPACE}
|
|
Log ${result.stdout}
|
|
Log ${result.stderr}
|
|
Should Be Equal As Integers ${result.rc} 0
|
|
Should Contain ${result.stdout} m1-project-create-link-ok
|
|
|
|
Full Plan Lifecycle Use Execute Diff Apply
|
|
[Documentation] Run full plan lifecycle: plan use -> plan execute -> plan diff -> plan apply
|
|
${result}= Run Process ${PYTHON} ${HELPER} plan-lifecycle cwd=${WORKSPACE}
|
|
Log ${result.stdout}
|
|
Log ${result.stderr}
|
|
Should Be Equal As Integers ${result.rc} 0
|
|
Should Contain ${result.stdout} m1-plan-lifecycle-ok
|
|
|
|
SQLite Persistence For Plan And Action Records
|
|
[Documentation] Verify Plan and Action records persist to SQLite with correct serialisation
|
|
${result}= Run Process ${PYTHON} ${HELPER} sqlite-persistence cwd=${WORKSPACE}
|
|
Log ${result.stdout}
|
|
Log ${result.stderr}
|
|
Should Be Equal As Integers ${result.rc} 0
|
|
Should Contain ${result.stdout} m1-sqlite-persistence-ok
|
|
|
|
ChangeSet Built From Tool Invocations
|
|
[Documentation] Verify ChangeSet is built from tool invocations, not parsed CLI output
|
|
${result}= Run Process ${PYTHON} ${HELPER} changeset-invocations cwd=${WORKSPACE}
|
|
Log ${result.stdout}
|
|
Log ${result.stderr}
|
|
Should Be Equal As Integers ${result.rc} 0
|
|
Should Contain ${result.stdout} m1-changeset-invocations-ok
|
|
|
|
Git Worktree Sandbox Isolation
|
|
[Documentation] Verify git worktree sandbox creates isolated directory and changes do not affect original until apply
|
|
${result}= Run Process ${PYTHON} ${HELPER} sandbox-isolation cwd=${WORKSPACE}
|
|
Log ${result.stdout}
|
|
Log ${result.stderr}
|
|
Should Be Equal As Integers ${result.rc} 0
|
|
Should Contain ${result.stdout} m1-sandbox-isolation-ok
|
|
|
|
Post Apply Commit Exists In Target Repo
|
|
[Documentation] Verify post-apply commit exists in the target repo after sandbox commit
|
|
${result}= Run Process ${PYTHON} ${HELPER} post-apply-commit cwd=${WORKSPACE}
|
|
Log ${result.stdout}
|
|
Log ${result.stderr}
|
|
Should Be Equal As Integers ${result.rc} 0
|
|
Should Contain ${result.stdout} m1-post-apply-commit-ok
|