8ea00f5185
CI / unit_tests (push) Has been cancelled
CI / benchmark-publish (push) Has been cancelled
CI / lint (push) Has been cancelled
CI / typecheck (push) Has been cancelled
CI / security (push) Has been cancelled
CI / quality (push) Has been cancelled
CI / integration_tests (push) Has been cancelled
CI / e2e_tests (push) Has been cancelled
CI / coverage (push) Has been cancelled
CI / benchmark-regression (push) Has been cancelled
CI / build (push) Has been cancelled
CI / push-validation (push) Has been cancelled
CI / status-check (push) Has been cancelled
CI / docker (push) Has been cancelled
CI / helm (push) Has been cancelled
Co-authored-by: Jeffrey Phillips Freeman <the@jeffreyfreeman.me> Co-committed-by: Jeffrey Phillips Freeman <the@jeffreyfreeman.me>
1520 lines
78 KiB
JSON
1520 lines
78 KiB
JSON
{
|
|
"framework": "generic",
|
|
"tests": [
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"==============================================================================",
|
|
"E2E "
|
|
],
|
|
"rawOutput": "==============================================================================\nE2E "
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"==============================================================================",
|
|
"E2E.E2E Session Create Persist :: Bug #1141 — session create does not persi..."
|
|
],
|
|
"rawOutput": "==============================================================================\nE2E.E2E Session Create Persist :: Bug #1141 — session create does not persi..."
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"=============================================================================="
|
|
],
|
|
"rawOutput": "=============================================================================="
|
|
},
|
|
{
|
|
"name": "Output Block 4",
|
|
"passed": true,
|
|
"output": [
|
|
"Session Create Then List Shows Session :: Create a session and ver... | PASS |"
|
|
],
|
|
"rawOutput": "Session Create Then List Shows Session :: Create a session and ver... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 6",
|
|
"passed": false,
|
|
"output": [
|
|
"E2E.E2E Session Create Persist :: Bug #1141 — session create does ... | PASS |",
|
|
"1 test, 1 passed, 0 failed"
|
|
],
|
|
"rawOutput": "E2E.E2E Session Create Persist :: Bug #1141 — session create does ... | PASS |\n1 test, 1 passed, 0 failed"
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"==============================================================================",
|
|
"E2E.M1 Acceptance :: E2E acceptance test for M1 - minimal plan execution f..."
|
|
],
|
|
"rawOutput": "==============================================================================\nE2E.M1 Acceptance :: E2E acceptance test for M1 - minimal plan execution f..."
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"=============================================================================="
|
|
],
|
|
"rawOutput": "=============================================================================="
|
|
},
|
|
{
|
|
"name": "Output Block 9",
|
|
"passed": true,
|
|
"output": [
|
|
"M1 Full Plan Lifecycle :: Exercise the complete M1 plan lifecycle ... | PASS |"
|
|
],
|
|
"rawOutput": "M1 Full Plan Lifecycle :: Exercise the complete M1 plan lifecycle ... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 11",
|
|
"passed": false,
|
|
"output": [
|
|
"E2E.M1 Acceptance :: E2E acceptance test for M1 - minimal plan ex... | PASS |",
|
|
"1 test, 1 passed, 0 failed"
|
|
],
|
|
"rawOutput": "E2E.M1 Acceptance :: E2E acceptance test for M1 - minimal plan ex... | PASS |\n1 test, 1 passed, 0 failed"
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"==============================================================================",
|
|
"E2E.M2 Acceptance :: E2E acceptance test for M2 (v3.1.0): Actor Compiler + ..."
|
|
],
|
|
"rawOutput": "==============================================================================\nE2E.M2 Acceptance :: E2E acceptance test for M2 (v3.1.0): Actor Compiler + ..."
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"=============================================================================="
|
|
],
|
|
"rawOutput": "=============================================================================="
|
|
},
|
|
{
|
|
"name": "Output Block 14",
|
|
"passed": true,
|
|
"output": [
|
|
"M2 Full Actor Compiler And LLM Integration :: End-to-end acceptanc... | PASS |"
|
|
],
|
|
"rawOutput": "M2 Full Actor Compiler And LLM Integration :: End-to-end acceptanc... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 16",
|
|
"passed": false,
|
|
"output": [
|
|
"E2E.M2 Acceptance :: E2E acceptance test for M2 (v3.1.0): Actor Co... | PASS |",
|
|
"1 test, 1 passed, 0 failed"
|
|
],
|
|
"rawOutput": "E2E.M2 Acceptance :: E2E acceptance test for M2 (v3.1.0): Actor Co... | PASS |\n1 test, 1 passed, 0 failed"
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"==============================================================================",
|
|
"E2E.M5 Acceptance :: M5 (v3.4.0) E2E acceptance test — ACMS v1 and context ..."
|
|
],
|
|
"rawOutput": "==============================================================================\nE2E.M5 Acceptance :: M5 (v3.4.0) E2E acceptance test — ACMS v1 and context ..."
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"=============================================================================="
|
|
],
|
|
"rawOutput": "=============================================================================="
|
|
},
|
|
{
|
|
"name": "Output Block 19",
|
|
"passed": true,
|
|
"output": [
|
|
"Context Assembly — Add Files To Context :: ``context-load`` adds f... | PASS |"
|
|
],
|
|
"rawOutput": "Context Assembly — Add Files To Context :: ``context-load`` adds f... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 21",
|
|
"passed": true,
|
|
"output": [
|
|
"Context Assembly — Show File Content :: ``context show <file>`` di... | PASS |"
|
|
],
|
|
"rawOutput": "Context Assembly — Show File Content :: ``context show <file>`` di... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 23",
|
|
"passed": true,
|
|
"output": [
|
|
"Context Assembly — Show Context Summary :: ``context show`` (no ar... | PASS |"
|
|
],
|
|
"rawOutput": "Context Assembly — Show Context Summary :: ``context show`` (no ar... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 25",
|
|
"passed": true,
|
|
"output": [
|
|
"Context Assembly — Clear Context :: ``context clear --yes`` remove... | PASS |"
|
|
],
|
|
"rawOutput": "Context Assembly — Clear Context :: ``context clear --yes`` remove... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 27",
|
|
"passed": true,
|
|
"output": [
|
|
"Context Scaling — Structural Plumbing for 10K File Projects :: **S... | PASS |"
|
|
],
|
|
"rawOutput": "Context Scaling — Structural Plumbing for 10K File Projects :: **S... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 29",
|
|
"passed": true,
|
|
"output": [
|
|
"Context Policy — Create Project For Policy Tests :: Pre-requisite:... | PASS |"
|
|
],
|
|
"rawOutput": "Context Policy — Create Project For Policy Tests :: Pre-requisite:... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 31",
|
|
"passed": true,
|
|
"output": [
|
|
"Context Policy - Set Default View :: Configure the default context... | PASS |"
|
|
],
|
|
"rawOutput": "Context Policy - Set Default View :: Configure the default context... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 33",
|
|
"passed": true,
|
|
"output": [
|
|
"Context Policy - Set Strategize View Override :: The strategize vi... | PASS |"
|
|
],
|
|
"rawOutput": "Context Policy - Set Strategize View Override :: The strategize vi... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 35",
|
|
"passed": true,
|
|
"output": [
|
|
"Context Policy - Verify Default View :: ``project context show --v... | PASS |"
|
|
],
|
|
"rawOutput": "Context Policy - Verify Default View :: ``project context show --v... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 37",
|
|
"passed": true,
|
|
"output": [
|
|
"Context Policy - Verify Strategize View :: ``project context show ... | PASS |"
|
|
],
|
|
"rawOutput": "Context Policy - Verify Strategize View :: ``project context show ... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 39",
|
|
"passed": true,
|
|
"output": [
|
|
"Budget Enforcement — Create Project With Tight Budget :: Create a ... | PASS |"
|
|
],
|
|
"rawOutput": "Budget Enforcement — Create Project With Tight Budget :: Create a ... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 41",
|
|
"passed": true,
|
|
"output": [
|
|
"Budget Enforcement — Verify Constraints Stored :: The JSON policy ... | PASS |"
|
|
],
|
|
"rawOutput": "Budget Enforcement — Verify Constraints Stored :: The JSON policy ... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 43",
|
|
"passed": true,
|
|
"output": [
|
|
"Budget Enforcement — Simulate Context Assembly (Structural) :: **S... | PASS |"
|
|
],
|
|
"rawOutput": "Budget Enforcement — Simulate Context Assembly (Structural) :: **S... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 45",
|
|
"passed": true,
|
|
"output": [
|
|
"Context Analysis — Create Project With ACMS Config :: Create a pro... | PASS |"
|
|
],
|
|
"rawOutput": "Context Analysis — Create Project With ACMS Config :: Create a pro... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 47",
|
|
"passed": true,
|
|
"output": [
|
|
"Context Analysis - Inspect Context Tiers (Structural) :: **Structu... | PASS |"
|
|
],
|
|
"rawOutput": "Context Analysis - Inspect Context Tiers (Structural) :: **Structu... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 49",
|
|
"passed": true,
|
|
"output": [
|
|
"Context Analysis - Simulate Produces Structured Output :: **Struct... | PASS |"
|
|
],
|
|
"rawOutput": "Context Analysis - Simulate Produces Structured Output :: **Struct... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 51",
|
|
"passed": true,
|
|
"output": [
|
|
"Context Analysis - Show Full Policy With ACMS Config :: ``project ... | PASS |"
|
|
],
|
|
"rawOutput": "Context Analysis - Show Full Policy With ACMS Config :: ``project ... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 53",
|
|
"passed": true,
|
|
"output": [
|
|
"Plan Execution — Create Project And Configure ACMS :: Set up a pro... | PASS |"
|
|
],
|
|
"rawOutput": "Plan Execution — Create Project And Configure ACMS :: Set up a pro... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 55",
|
|
"passed": true,
|
|
"output": [
|
|
"Plan Execution — Create Action :: Create an action definition from... | PASS |"
|
|
],
|
|
"rawOutput": "Plan Execution — Create Action :: Create an action definition from... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 57",
|
|
"passed": true,
|
|
"output": [
|
|
"Plan Execution — Create Plan With Plan Use :: ``plan use`` creates... | PASS |"
|
|
],
|
|
"rawOutput": "Plan Execution — Create Plan With Plan Use :: ``plan use`` creates... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 59",
|
|
"passed": true,
|
|
"output": [
|
|
"Plan Execution — Resume Plan For LLM Processing :: ``plan resume``... | PASS |"
|
|
],
|
|
"rawOutput": "Plan Execution — Resume Plan For LLM Processing :: ``plan resume``... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 61",
|
|
"passed": false,
|
|
"output": [
|
|
"E2E.M5 Acceptance :: M5 (v3.4.0) E2E acceptance test — ACMS v1 and... | PASS |",
|
|
"21 tests, 21 passed, 0 failed"
|
|
],
|
|
"rawOutput": "E2E.M5 Acceptance :: M5 (v3.4.0) E2E acceptance test — ACMS v1 and... | PASS |\n21 tests, 21 passed, 0 failed"
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"==============================================================================",
|
|
"E2E.M6 Acceptance :: E2E acceptance criteria for M6 (v3.5.0) — autonomy har..."
|
|
],
|
|
"rawOutput": "==============================================================================\nE2E.M6 Acceptance :: E2E acceptance criteria for M6 (v3.5.0) — autonomy har..."
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"=============================================================================="
|
|
],
|
|
"rawOutput": "=============================================================================="
|
|
},
|
|
{
|
|
"name": "Output Block 64",
|
|
"passed": true,
|
|
"output": [
|
|
"M6 E2E Session Lifecycle :: Create, list, show, and delete a sessi... | PASS |"
|
|
],
|
|
"rawOutput": "M6 E2E Session Lifecycle :: Create, list, show, and delete a sessi... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 66",
|
|
"passed": true,
|
|
"output": [
|
|
"M6 E2E Automation Profile List :: Verify all eight built-in automa... | PASS |"
|
|
],
|
|
"rawOutput": "M6 E2E Automation Profile List :: Verify all eight built-in automa... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 68",
|
|
"passed": true,
|
|
"output": [
|
|
"M6 E2E Automation Profile Show :: Verify showing a single automati... | PASS |"
|
|
],
|
|
"rawOutput": "M6 E2E Automation Profile Show :: Verify showing a single automati... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 70",
|
|
"passed": true,
|
|
"output": [
|
|
"M6 E2E Config Automation Profile :: Set and get the automation pro... | PASS |"
|
|
],
|
|
"rawOutput": "M6 E2E Config Automation Profile :: Set and get the automation pro... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 72",
|
|
"passed": true,
|
|
"output": [
|
|
"M6 E2E Init And Project Setup :: Initialize, add a git resource, c... | PASS |"
|
|
],
|
|
"rawOutput": "M6 E2E Init And Project Setup :: Initialize, add a git resource, c... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 74",
|
|
"passed": true,
|
|
"output": [
|
|
"M6 E2E Guard Enforcement Denylist Budget Limits :: Register a cust... | PASS |"
|
|
],
|
|
"rawOutput": "M6 E2E Guard Enforcement Denylist Budget Limits :: Register a cust... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 76",
|
|
"passed": true,
|
|
"output": [
|
|
"M6 E2E Plan Lifecycle Via CLI :: Test A2A facade plan lifecycle: c... | PASS |"
|
|
],
|
|
"rawOutput": "M6 E2E Plan Lifecycle Via CLI :: Test A2A facade plan lifecycle: c... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 78",
|
|
"passed": true,
|
|
"output": [
|
|
"M6 E2E Guard Enforcement Via Profile :: Verify guard enforcement w... | PASS |"
|
|
],
|
|
"rawOutput": "M6 E2E Guard Enforcement Via Profile :: Verify guard enforcement w... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 80",
|
|
"passed": true,
|
|
"output": [
|
|
"M6 E2E Profile Precedence Plan Overrides Global :: Verify plan-lev... | PASS |"
|
|
],
|
|
"rawOutput": "M6 E2E Profile Precedence Plan Overrides Global :: Verify plan-lev... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 82",
|
|
"passed": true,
|
|
"output": [
|
|
"M6 E2E Event Queue Via Plan Lifecycle Transitions :: Exercise even... | PASS |"
|
|
],
|
|
"rawOutput": "M6 E2E Event Queue Via Plan Lifecycle Transitions :: Exercise even... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 84",
|
|
"passed": true,
|
|
"output": [
|
|
"M6 E2E Hierarchical Decomposition Via Plan Tree :: Verify hierarch... | PASS |"
|
|
],
|
|
"rawOutput": "M6 E2E Hierarchical Decomposition Via Plan Tree :: Verify hierarch... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 86",
|
|
"passed": true,
|
|
"output": [
|
|
"M6 E2E Full Autonomy Acceptance Flow :: End-to-end: init, resource... | PASS |"
|
|
],
|
|
"rawOutput": "M6 E2E Full Autonomy Acceptance Flow :: End-to-end: init, resource... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 88",
|
|
"passed": false,
|
|
"output": [
|
|
"E2E.M6 Acceptance :: E2E acceptance criteria for M6 (v3.5.0) — aut... | PASS |",
|
|
"12 tests, 12 passed, 0 failed"
|
|
],
|
|
"rawOutput": "E2E.M6 Acceptance :: E2E acceptance criteria for M6 (v3.5.0) — aut... | PASS |\n12 tests, 12 passed, 0 failed"
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"==============================================================================",
|
|
"E2E.Smoke Test :: Minimal E2E smoke test to validate the E2E test infrastru..."
|
|
],
|
|
"rawOutput": "==============================================================================\nE2E.Smoke Test :: Minimal E2E smoke test to validate the E2E test infrastru..."
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"=============================================================================="
|
|
],
|
|
"rawOutput": "=============================================================================="
|
|
},
|
|
{
|
|
"name": "Output Block 91",
|
|
"passed": true,
|
|
"output": [
|
|
"CleverAgents Version Smoke Test :: Verify the CleverAgents CLI res... | PASS |"
|
|
],
|
|
"rawOutput": "CleverAgents Version Smoke Test :: Verify the CleverAgents CLI res... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 93",
|
|
"passed": true,
|
|
"output": [
|
|
"CleverAgents Help Smoke Test :: Verify the CleverAgents CLI respon... | PASS |"
|
|
],
|
|
"rawOutput": "CleverAgents Help Smoke Test :: Verify the CleverAgents CLI respon... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 95",
|
|
"passed": false,
|
|
"output": [
|
|
"E2E.Smoke Test :: Minimal E2E smoke test to validate the E2E test ... | PASS |",
|
|
"2 tests, 2 passed, 0 failed"
|
|
],
|
|
"rawOutput": "E2E.Smoke Test :: Minimal E2E smoke test to validate the E2E test ... | PASS |\n2 tests, 2 passed, 0 failed"
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"==============================================================================",
|
|
"E2E.Tdd Acms Behavioral Validation :: TDD Issue #1028 — ACMS indexing pipel..."
|
|
],
|
|
"rawOutput": "==============================================================================\nE2E.Tdd Acms Behavioral Validation :: TDD Issue #1028 — ACMS indexing pipel..."
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"=============================================================================="
|
|
],
|
|
"rawOutput": "=============================================================================="
|
|
},
|
|
{
|
|
"name": "Output Block 98",
|
|
"passed": true,
|
|
"output": [
|
|
"Context Simulate Returns Non-Empty Tier Data :: Run ``project cont... | PASS |"
|
|
],
|
|
"rawOutput": "Context Simulate Returns Non-Empty Tier Data :: Run ``project cont... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 100",
|
|
"passed": true,
|
|
"output": [
|
|
"Context Inspect Shows Indexed Resources :: Run ``project context i... | PASS |"
|
|
],
|
|
"rawOutput": "Context Inspect Shows Indexed Resources :: Run ``project context i... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 102",
|
|
"passed": true,
|
|
"output": [
|
|
"Budget Enforcement Excludes Oversized Files :: Configure ``max_fil... | PASS |"
|
|
],
|
|
"rawOutput": "Budget Enforcement Excludes Oversized Files :: Configure ``max_fil... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 104",
|
|
"passed": true,
|
|
"output": [
|
|
"Large Project Indexes Without Timeout :: Create a synthetic 10,000... | PASS |"
|
|
],
|
|
"rawOutput": "Large Project Indexes Without Timeout :: Create a synthetic 10,000... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 106",
|
|
"passed": false,
|
|
"output": [
|
|
"E2E.Tdd Acms Behavioral Validation :: TDD Issue #1028 — ACMS index... | PASS |",
|
|
"4 tests, 4 passed, 0 failed"
|
|
],
|
|
"rawOutput": "E2E.Tdd Acms Behavioral Validation :: TDD Issue #1028 — ACMS index... | PASS |\n4 tests, 4 passed, 0 failed"
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"==============================================================================",
|
|
"E2E.Wf04 Multi Project :: E2E test for Workflow Example 4: Multi-Project De..."
|
|
],
|
|
"rawOutput": "==============================================================================\nE2E.Wf04 Multi Project :: E2E test for Workflow Example 4: Multi-Project De..."
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"=============================================================================="
|
|
],
|
|
"rawOutput": "=============================================================================="
|
|
},
|
|
{
|
|
"name": "Output Block 109",
|
|
"passed": true,
|
|
"output": [
|
|
"WF04 Multi Project Dependency Update Supervised Profile :: Full su... | PASS |"
|
|
],
|
|
"rawOutput": "WF04 Multi Project Dependency Update Supervised Profile :: Full su... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 111",
|
|
"passed": false,
|
|
"output": [
|
|
"E2E.Wf04 Multi Project :: E2E test for Workflow Example 4: Multi-P... | PASS |",
|
|
"1 test, 1 passed, 0 failed"
|
|
],
|
|
"rawOutput": "E2E.Wf04 Multi Project :: E2E test for Workflow Example 4: Multi-P... | PASS |\n1 test, 1 passed, 0 failed"
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"==============================================================================",
|
|
"E2E.Wf05 Db Migration :: E2E test for Workflow Example 5: Database Schema M..."
|
|
],
|
|
"rawOutput": "==============================================================================\nE2E.Wf05 Db Migration :: E2E test for Workflow Example 5: Database Schema M..."
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"=============================================================================="
|
|
],
|
|
"rawOutput": "=============================================================================="
|
|
},
|
|
{
|
|
"name": "Output Block 114",
|
|
"passed": true,
|
|
"output": [
|
|
"WF05 Database Schema Migration With Safety Nets Review Profile :: ... | PASS |"
|
|
],
|
|
"rawOutput": "WF05 Database Schema Migration With Safety Nets Review Profile :: ... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 116",
|
|
"passed": false,
|
|
"output": [
|
|
"E2E.Wf05 Db Migration :: E2E test for Workflow Example 5: Database... | PASS |",
|
|
"1 test, 1 passed, 0 failed"
|
|
],
|
|
"rawOutput": "E2E.Wf05 Db Migration :: E2E test for Workflow Example 5: Database... | PASS |\n1 test, 1 passed, 0 failed"
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"==============================================================================",
|
|
"E2E.Wf07 Cicd :: E2E test for Workflow Example 7: CI/CD integration, automa..."
|
|
],
|
|
"rawOutput": "==============================================================================\nE2E.Wf07 Cicd :: E2E test for Workflow Example 7: CI/CD integration, automa..."
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"=============================================================================="
|
|
],
|
|
"rawOutput": "=============================================================================="
|
|
},
|
|
{
|
|
"name": "Output Block 119",
|
|
"passed": true,
|
|
"output": [
|
|
"WF07 E2E CI Profile Configuration :: Set and verify the ci automat... | PASS |"
|
|
],
|
|
"rawOutput": "WF07 E2E CI Profile Configuration :: Set and verify the ci automat... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 121",
|
|
"passed": true,
|
|
"output": [
|
|
"WF07 E2E Idempotent Resource Registration :: Register a git-checko... | PASS |"
|
|
],
|
|
"rawOutput": "WF07 E2E Idempotent Resource Registration :: Register a git-checko... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 123",
|
|
"passed": true,
|
|
"output": [
|
|
"WF07 E2E Idempotent Project Registration :: Create a project linke... | PASS |"
|
|
],
|
|
"rawOutput": "WF07 E2E Idempotent Project Registration :: Create a project linke... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 125",
|
|
"passed": true,
|
|
"output": [
|
|
"WF07 E2E Validation Registration :: Register lint, typecheck, and ... | PASS |"
|
|
],
|
|
"rawOutput": "WF07 E2E Validation Registration :: Register lint, typecheck, and ... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 127",
|
|
"passed": true,
|
|
"output": [
|
|
"WF07 E2E CI Plan Launch :: Create an action and launch a plan with... | PASS |"
|
|
],
|
|
"rawOutput": "WF07 E2E CI Plan Launch :: Create an action and launch a plan with... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 129",
|
|
"passed": true,
|
|
"output": [
|
|
"WF07 E2E JSON Output Verification :: Verify that --format json pro... | PASS |"
|
|
],
|
|
"rawOutput": "WF07 E2E JSON Output Verification :: Verify that --format json pro... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 131",
|
|
"passed": false,
|
|
"output": [
|
|
"E2E.Wf07 Cicd :: E2E test for Workflow Example 7: CI/CD integratio... | PASS |",
|
|
"6 tests, 6 passed, 0 failed"
|
|
],
|
|
"rawOutput": "E2E.Wf07 Cicd :: E2E test for Workflow Example 7: CI/CD integratio... | PASS |\n6 tests, 6 passed, 0 failed"
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"==============================================================================",
|
|
"E2E.Wf12 Hierarchical :: E2E test for Workflow Example 12: Large-Scale Hier..."
|
|
],
|
|
"rawOutput": "==============================================================================\nE2E.Wf12 Hierarchical :: E2E test for Workflow Example 12: Large-Scale Hier..."
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"=============================================================================="
|
|
],
|
|
"rawOutput": "=============================================================================="
|
|
},
|
|
{
|
|
"name": "Output Block 134",
|
|
"passed": true,
|
|
"output": [
|
|
"WF12 Large Scale Hierarchical Feature Implementation :: Supervised... | PASS |"
|
|
],
|
|
"rawOutput": "WF12 Large Scale Hierarchical Feature Implementation :: Supervised... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 136",
|
|
"passed": false,
|
|
"output": [
|
|
"E2E.Wf12 Hierarchical :: E2E test for Workflow Example 12: Large-S... | PASS |",
|
|
"1 test, 1 passed, 0 failed"
|
|
],
|
|
"rawOutput": "E2E.Wf12 Hierarchical :: E2E test for Workflow Example 12: Large-S... | PASS |\n1 test, 1 passed, 0 failed"
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"==============================================================================",
|
|
"E2E.Wf14 Server Mode :: E2E test for Workflow Example 14: server mode team ..."
|
|
],
|
|
"rawOutput": "==============================================================================\nE2E.Wf14 Server Mode :: E2E test for Workflow Example 14: server mode team ..."
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"=============================================================================="
|
|
],
|
|
"rawOutput": "=============================================================================="
|
|
},
|
|
{
|
|
"name": "Output Block 139",
|
|
"passed": true,
|
|
"output": [
|
|
"WF14 E2E Server Config Setup :: Configure server URL, authenticati... | PASS |"
|
|
],
|
|
"rawOutput": "WF14 E2E Server Config Setup :: Configure server URL, authenticati... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 141",
|
|
"passed": true,
|
|
"output": [
|
|
"WF14 E2E Diagnostics :: Run diagnostics and verify basic health-ch... | PASS |"
|
|
],
|
|
"rawOutput": "WF14 E2E Diagnostics :: Run diagnostics and verify basic health-ch... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 143",
|
|
"passed": true,
|
|
"output": [
|
|
"WF14 E2E Action Create For Namespace :: Create an action in the te... | PASS |"
|
|
],
|
|
"rawOutput": "WF14 E2E Action Create For Namespace :: Create an action in the te... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 145",
|
|
"passed": true,
|
|
"output": [
|
|
"WF14 E2E Action List By Namespace :: List shared actions filtered ... | PASS |"
|
|
],
|
|
"rawOutput": "WF14 E2E Action List By Namespace :: List shared actions filtered ... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 147",
|
|
"passed": true,
|
|
"output": [
|
|
"WF14 E2E Actor Add For Namespace :: Add an actor from YAML configu... | PASS |"
|
|
],
|
|
"rawOutput": "WF14 E2E Actor Add For Namespace :: Add an actor from YAML configu... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 149",
|
|
"passed": true,
|
|
"output": [
|
|
"WF14 E2E Plan List :: Verify that the plan list command executes w... | PASS |"
|
|
],
|
|
"rawOutput": "WF14 E2E Plan List :: Verify that the plan list command executes w... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 151",
|
|
"passed": true,
|
|
"output": [
|
|
"WF14 E2E Supervised Profile Verification :: Verify the built-in su... | PASS |"
|
|
],
|
|
"rawOutput": "WF14 E2E Supervised Profile Verification :: Verify the built-in su... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 153",
|
|
"passed": false,
|
|
"output": [
|
|
"E2E.Wf14 Server Mode :: E2E test for Workflow Example 14: server m... | PASS |",
|
|
"7 tests, 7 passed, 0 failed"
|
|
],
|
|
"rawOutput": "E2E.Wf14 Server Mode :: E2E test for Workflow Example 14: server m... | PASS |\n7 tests, 7 passed, 0 failed"
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"==============================================================================",
|
|
"E2E.Wf16 Devcontainer :: E2E test for Workflow Example 16: Devcontainer-Dri..."
|
|
],
|
|
"rawOutput": "==============================================================================\nE2E.Wf16 Devcontainer :: E2E test for Workflow Example 16: Devcontainer-Dri..."
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"=============================================================================="
|
|
],
|
|
"rawOutput": "=============================================================================="
|
|
},
|
|
{
|
|
"name": "Output Block 156",
|
|
"passed": true,
|
|
"output": [
|
|
"WF16 Devcontainer Driven Development Supervised Profile :: Supervi... | PASS |"
|
|
],
|
|
"rawOutput": "WF16 Devcontainer Driven Development Supervised Profile :: Supervi... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 158",
|
|
"passed": false,
|
|
"output": [
|
|
"E2E.Wf16 Devcontainer :: E2E test for Workflow Example 16: Devcont... | PASS |",
|
|
"1 test, 1 passed, 0 failed"
|
|
],
|
|
"rawOutput": "E2E.Wf16 Devcontainer :: E2E test for Workflow Example 16: Devcont... | PASS |\n1 test, 1 passed, 0 failed"
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"==============================================================================",
|
|
"E2E.Wf17 Explicit Container :: E2E test for Workflow Example 17: Explicit C..."
|
|
],
|
|
"rawOutput": "==============================================================================\nE2E.Wf17 Explicit Container :: E2E test for Workflow Example 17: Explicit C..."
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"=============================================================================="
|
|
],
|
|
"rawOutput": "=============================================================================="
|
|
},
|
|
{
|
|
"name": "Output Block 161",
|
|
"passed": true,
|
|
"output": [
|
|
"WF17 Explicit Container With Directory Mount Trusted Profile :: Tr... | PASS |"
|
|
],
|
|
"rawOutput": "WF17 Explicit Container With Directory Mount Trusted Profile :: Tr... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 163",
|
|
"passed": true,
|
|
"output": [
|
|
"WF17 TDD Dual Mount Registration :: Regression guard for AC #2: Re... | PASS |"
|
|
],
|
|
"rawOutput": "WF17 TDD Dual Mount Registration :: Regression guard for AC #2: Re... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 165",
|
|
"passed": true,
|
|
"output": [
|
|
"WF17 TDD Project Level Execution Env Priority Override :: TDD test... | PASS |"
|
|
],
|
|
"rawOutput": "WF17 TDD Project Level Execution Env Priority Override :: TDD test... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 167",
|
|
"passed": true,
|
|
"output": [
|
|
"WF17 TDD Precedence Level 2 Project Override Resolution :: TDD tes... | PASS |"
|
|
],
|
|
"rawOutput": "WF17 TDD Precedence Level 2 Project Override Resolution :: TDD tes... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 169",
|
|
"passed": false,
|
|
"output": [
|
|
"E2E.Wf17 Explicit Container :: E2E test for Workflow Example 17: E... | PASS |",
|
|
"4 tests, 4 passed, 0 failed"
|
|
],
|
|
"rawOutput": "E2E.Wf17 Explicit Container :: E2E test for Workflow Example 17: E... | PASS |\n4 tests, 4 passed, 0 failed"
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"==============================================================================",
|
|
"E2E.Wf17 Project Exec Env Priority :: WF17: Project-level execution environ..."
|
|
],
|
|
"rawOutput": "==============================================================================\nE2E.Wf17 Project Exec Env Priority :: WF17: Project-level execution environ..."
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"=============================================================================="
|
|
],
|
|
"rawOutput": "=============================================================================="
|
|
},
|
|
{
|
|
"name": "Output Block 172",
|
|
"passed": true,
|
|
"output": [
|
|
"Project Context Set Accepts Execution Env Priority :: WF17 AC1: pr... | PASS |"
|
|
],
|
|
"rawOutput": "Project Context Set Accepts Execution Env Priority :: WF17 AC1: pr... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 174",
|
|
"passed": true,
|
|
"output": [
|
|
"Project Context Show Displays Execution Env Priority :: WF17 AC2: ... | PASS |"
|
|
],
|
|
"rawOutput": "Project Context Show Displays Execution Env Priority :: WF17 AC2: ... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 176",
|
|
"passed": false,
|
|
"output": [
|
|
"E2E.Wf17 Project Exec Env Priority :: WF17: Project-level executio... | PASS |",
|
|
"2 tests, 2 passed, 0 failed"
|
|
],
|
|
"rawOutput": "E2E.Wf17 Project Exec Env Priority :: WF17: Project-level executio... | PASS |\n2 tests, 2 passed, 0 failed"
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"==============================================================================",
|
|
"E2E.Wf18 Container Clone :: E2E test for Workflow Example 18: Container wit..."
|
|
],
|
|
"rawOutput": "==============================================================================\nE2E.Wf18 Container Clone :: E2E test for Workflow Example 18: Container wit..."
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"=============================================================================="
|
|
],
|
|
"rawOutput": "=============================================================================="
|
|
},
|
|
{
|
|
"name": "Output Block 179",
|
|
"passed": true,
|
|
"output": [
|
|
"WF18 Container With Remote Repo Clone Trusted Profile :: Trusted-p... | PASS |"
|
|
],
|
|
"rawOutput": "WF18 Container With Remote Repo Clone Trusted Profile :: Trusted-p... | PASS |"
|
|
},
|
|
{
|
|
"name": "------------------------------------------------------------------------------",
|
|
"passed": true,
|
|
"output": [
|
|
"------------------------------------------------------------------------------"
|
|
],
|
|
"rawOutput": "------------------------------------------------------------------------------"
|
|
},
|
|
{
|
|
"name": "Output Block 181",
|
|
"passed": false,
|
|
"output": [
|
|
"E2E.Wf18 Container Clone :: E2E test for Workflow Example 18: Cont... | PASS |",
|
|
"1 test, 1 passed, 0 failed"
|
|
],
|
|
"rawOutput": "E2E.Wf18 Container Clone :: E2E test for Workflow Example 18: Cont... | PASS |\n1 test, 1 passed, 0 failed"
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"=============================================================================="
|
|
],
|
|
"rawOutput": "=============================================================================="
|
|
},
|
|
{
|
|
"name": "Output Block 183",
|
|
"passed": false,
|
|
"output": [
|
|
"E2E | PASS |",
|
|
"66 tests, 66 passed, 0 failed"
|
|
],
|
|
"rawOutput": "E2E | PASS |\n66 tests, 66 passed, 0 failed"
|
|
},
|
|
{
|
|
"name": "==============================================================================",
|
|
"passed": true,
|
|
"output": [
|
|
"==============================================================================",
|
|
"Output: /app/output.xml",
|
|
"Log: /app/log.html",
|
|
"Report: /app/report.html"
|
|
],
|
|
"rawOutput": "==============================================================================\nOutput: /app/output.xml\nLog: /app/log.html\nReport: /app/report.html"
|
|
}
|
|
],
|
|
"summary": {
|
|
"total": 184,
|
|
"passed": 167,
|
|
"failed": 17
|
|
},
|
|
"rawOutput": "==============================================================================\nE2E \n==============================================================================\nE2E.E2E Session Create Persist :: Bug #1141 — session create does not persi...\n==============================================================================\nSession Create Then List Shows Session :: Create a session and ver... | PASS |\n------------------------------------------------------------------------------\nE2E.E2E Session Create Persist :: Bug #1141 — session create does ... | PASS |\n1 test, 1 passed, 0 failed\n==============================================================================\nE2E.M1 Acceptance :: E2E acceptance test for M1 - minimal plan execution f...\n==============================================================================\nM1 Full Plan Lifecycle :: Exercise the complete M1 plan lifecycle ... | PASS |\n------------------------------------------------------------------------------\nE2E.M1 Acceptance :: E2E acceptance test for M1 - minimal plan ex... | PASS |\n1 test, 1 passed, 0 failed\n==============================================================================\nE2E.M2 Acceptance :: E2E acceptance test for M2 (v3.1.0): Actor Compiler + ...\n==============================================================================\nM2 Full Actor Compiler And LLM Integration :: End-to-end acceptanc... | PASS |\n------------------------------------------------------------------------------\nE2E.M2 Acceptance :: E2E acceptance test for M2 (v3.1.0): Actor Co... | PASS |\n1 test, 1 passed, 0 failed\n==============================================================================\nE2E.M5 Acceptance :: M5 (v3.4.0) E2E acceptance test — ACMS v1 and context ...\n==============================================================================\nContext Assembly — Add Files To Context :: ``context-load`` adds f... | PASS |\n------------------------------------------------------------------------------\nContext Assembly — Show File Content :: ``context show <file>`` di... | PASS |\n------------------------------------------------------------------------------\nContext Assembly — Show Context Summary :: ``context show`` (no ar... | PASS |\n------------------------------------------------------------------------------\nContext Assembly — Clear Context :: ``context clear --yes`` remove... | PASS |\n------------------------------------------------------------------------------\nContext Scaling — Structural Plumbing for 10K File Projects :: **S... | PASS |\n------------------------------------------------------------------------------\nContext Policy — Create Project For Policy Tests :: Pre-requisite:... | PASS |\n------------------------------------------------------------------------------\nContext Policy - Set Default View :: Configure the default context... | PASS |\n------------------------------------------------------------------------------\nContext Policy - Set Strategize View Override :: The strategize vi... | PASS |\n------------------------------------------------------------------------------\nContext Policy - Verify Default View :: ``project context show --v... | PASS |\n------------------------------------------------------------------------------\nContext Policy - Verify Strategize View :: ``project context show ... | PASS |\n------------------------------------------------------------------------------\nBudget Enforcement — Create Project With Tight Budget :: Create a ... | PASS |\n------------------------------------------------------------------------------\nBudget Enforcement — Verify Constraints Stored :: The JSON policy ... | PASS |\n------------------------------------------------------------------------------\nBudget Enforcement — Simulate Context Assembly (Structural) :: **S... | PASS |\n------------------------------------------------------------------------------\nContext Analysis — Create Project With ACMS Config :: Create a pro... | PASS |\n------------------------------------------------------------------------------\nContext Analysis - Inspect Context Tiers (Structural) :: **Structu... | PASS |\n------------------------------------------------------------------------------\nContext Analysis - Simulate Produces Structured Output :: **Struct... | PASS |\n------------------------------------------------------------------------------\nContext Analysis - Show Full Policy With ACMS Config :: ``project ... | PASS |\n------------------------------------------------------------------------------\nPlan Execution — Create Project And Configure ACMS :: Set up a pro... | PASS |\n------------------------------------------------------------------------------\nPlan Execution — Create Action :: Create an action definition from... | PASS |\n------------------------------------------------------------------------------\nPlan Execution — Create Plan With Plan Use :: ``plan use`` creates... | PASS |\n------------------------------------------------------------------------------\nPlan Execution — Resume Plan For LLM Processing :: ``plan resume``... | PASS |\n------------------------------------------------------------------------------\nE2E.M5 Acceptance :: M5 (v3.4.0) E2E acceptance test — ACMS v1 and... | PASS |\n21 tests, 21 passed, 0 failed\n==============================================================================\nE2E.M6 Acceptance :: E2E acceptance criteria for M6 (v3.5.0) — autonomy har...\n==============================================================================\nM6 E2E Session Lifecycle :: Create, list, show, and delete a sessi... | PASS |\n------------------------------------------------------------------------------\nM6 E2E Automation Profile List :: Verify all eight built-in automa... | PASS |\n------------------------------------------------------------------------------\nM6 E2E Automation Profile Show :: Verify showing a single automati... | PASS |\n------------------------------------------------------------------------------\nM6 E2E Config Automation Profile :: Set and get the automation pro... | PASS |\n------------------------------------------------------------------------------\nM6 E2E Init And Project Setup :: Initialize, add a git resource, c... | PASS |\n------------------------------------------------------------------------------\nM6 E2E Guard Enforcement Denylist Budget Limits :: Register a cust... | PASS |\n------------------------------------------------------------------------------\nM6 E2E Plan Lifecycle Via CLI :: Test A2A facade plan lifecycle: c... | PASS |\n------------------------------------------------------------------------------\nM6 E2E Guard Enforcement Via Profile :: Verify guard enforcement w... | PASS |\n------------------------------------------------------------------------------\nM6 E2E Profile Precedence Plan Overrides Global :: Verify plan-lev... | PASS |\n------------------------------------------------------------------------------\nM6 E2E Event Queue Via Plan Lifecycle Transitions :: Exercise even... | PASS |\n------------------------------------------------------------------------------\nM6 E2E Hierarchical Decomposition Via Plan Tree :: Verify hierarch... | PASS |\n------------------------------------------------------------------------------\nM6 E2E Full Autonomy Acceptance Flow :: End-to-end: init, resource... | PASS |\n------------------------------------------------------------------------------\nE2E.M6 Acceptance :: E2E acceptance criteria for M6 (v3.5.0) — aut... | PASS |\n12 tests, 12 passed, 0 failed\n==============================================================================\nE2E.Smoke Test :: Minimal E2E smoke test to validate the E2E test infrastru...\n==============================================================================\nCleverAgents Version Smoke Test :: Verify the CleverAgents CLI res... | PASS |\n------------------------------------------------------------------------------\nCleverAgents Help Smoke Test :: Verify the CleverAgents CLI respon... | PASS |\n------------------------------------------------------------------------------\nE2E.Smoke Test :: Minimal E2E smoke test to validate the E2E test ... | PASS |\n2 tests, 2 passed, 0 failed\n==============================================================================\nE2E.Tdd Acms Behavioral Validation :: TDD Issue #1028 — ACMS indexing pipel...\n==============================================================================\nContext Simulate Returns Non-Empty Tier Data :: Run ``project cont... | PASS |\n------------------------------------------------------------------------------\nContext Inspect Shows Indexed Resources :: Run ``project context i... | PASS |\n------------------------------------------------------------------------------\nBudget Enforcement Excludes Oversized Files :: Configure ``max_fil... | PASS |\n------------------------------------------------------------------------------\nLarge Project Indexes Without Timeout :: Create a synthetic 10,000... | PASS |\n------------------------------------------------------------------------------\nE2E.Tdd Acms Behavioral Validation :: TDD Issue #1028 — ACMS index... | PASS |\n4 tests, 4 passed, 0 failed\n==============================================================================\nE2E.Wf04 Multi Project :: E2E test for Workflow Example 4: Multi-Project De...\n==============================================================================\nWF04 Multi Project Dependency Update Supervised Profile :: Full su... | PASS |\n------------------------------------------------------------------------------\nE2E.Wf04 Multi Project :: E2E test for Workflow Example 4: Multi-P... | PASS |\n1 test, 1 passed, 0 failed\n==============================================================================\nE2E.Wf05 Db Migration :: E2E test for Workflow Example 5: Database Schema M...\n==============================================================================\nWF05 Database Schema Migration With Safety Nets Review Profile :: ... | PASS |\n------------------------------------------------------------------------------\nE2E.Wf05 Db Migration :: E2E test for Workflow Example 5: Database... | PASS |\n1 test, 1 passed, 0 failed\n==============================================================================\nE2E.Wf07 Cicd :: E2E test for Workflow Example 7: CI/CD integration, automa...\n==============================================================================\nWF07 E2E CI Profile Configuration :: Set and verify the ci automat... | PASS |\n------------------------------------------------------------------------------\nWF07 E2E Idempotent Resource Registration :: Register a git-checko... | PASS |\n------------------------------------------------------------------------------\nWF07 E2E Idempotent Project Registration :: Create a project linke... | PASS |\n------------------------------------------------------------------------------\nWF07 E2E Validation Registration :: Register lint, typecheck, and ... | PASS |\n------------------------------------------------------------------------------\nWF07 E2E CI Plan Launch :: Create an action and launch a plan with... | PASS |\n------------------------------------------------------------------------------\nWF07 E2E JSON Output Verification :: Verify that --format json pro... | PASS |\n------------------------------------------------------------------------------\nE2E.Wf07 Cicd :: E2E test for Workflow Example 7: CI/CD integratio... | PASS |\n6 tests, 6 passed, 0 failed\n==============================================================================\nE2E.Wf12 Hierarchical :: E2E test for Workflow Example 12: Large-Scale Hier...\n==============================================================================\nWF12 Large Scale Hierarchical Feature Implementation :: Supervised... | PASS |\n------------------------------------------------------------------------------\nE2E.Wf12 Hierarchical :: E2E test for Workflow Example 12: Large-S... | PASS |\n1 test, 1 passed, 0 failed\n==============================================================================\nE2E.Wf14 Server Mode :: E2E test for Workflow Example 14: server mode team ...\n==============================================================================\nWF14 E2E Server Config Setup :: Configure server URL, authenticati... | PASS |\n------------------------------------------------------------------------------\nWF14 E2E Diagnostics :: Run diagnostics and verify basic health-ch... | PASS |\n------------------------------------------------------------------------------\nWF14 E2E Action Create For Namespace :: Create an action in the te... | PASS |\n------------------------------------------------------------------------------\nWF14 E2E Action List By Namespace :: List shared actions filtered ... | PASS |\n------------------------------------------------------------------------------\nWF14 E2E Actor Add For Namespace :: Add an actor from YAML configu... | PASS |\n------------------------------------------------------------------------------\nWF14 E2E Plan List :: Verify that the plan list command executes w... | PASS |\n------------------------------------------------------------------------------\nWF14 E2E Supervised Profile Verification :: Verify the built-in su... | PASS |\n------------------------------------------------------------------------------\nE2E.Wf14 Server Mode :: E2E test for Workflow Example 14: server m... | PASS |\n7 tests, 7 passed, 0 failed\n==============================================================================\nE2E.Wf16 Devcontainer :: E2E test for Workflow Example 16: Devcontainer-Dri...\n==============================================================================\nWF16 Devcontainer Driven Development Supervised Profile :: Supervi... | PASS |\n------------------------------------------------------------------------------\nE2E.Wf16 Devcontainer :: E2E test for Workflow Example 16: Devcont... | PASS |\n1 test, 1 passed, 0 failed\n==============================================================================\nE2E.Wf17 Explicit Container :: E2E test for Workflow Example 17: Explicit C...\n==============================================================================\nWF17 Explicit Container With Directory Mount Trusted Profile :: Tr... | PASS |\n------------------------------------------------------------------------------\nWF17 TDD Dual Mount Registration :: Regression guard for AC #2: Re... | PASS |\n------------------------------------------------------------------------------\nWF17 TDD Project Level Execution Env Priority Override :: TDD test... | PASS |\n------------------------------------------------------------------------------\nWF17 TDD Precedence Level 2 Project Override Resolution :: TDD tes... | PASS |\n------------------------------------------------------------------------------\nE2E.Wf17 Explicit Container :: E2E test for Workflow Example 17: E... | PASS |\n4 tests, 4 passed, 0 failed\n==============================================================================\nE2E.Wf17 Project Exec Env Priority :: WF17: Project-level execution environ...\n==============================================================================\nProject Context Set Accepts Execution Env Priority :: WF17 AC1: pr... | PASS |\n------------------------------------------------------------------------------\nProject Context Show Displays Execution Env Priority :: WF17 AC2: ... | PASS |\n------------------------------------------------------------------------------\nE2E.Wf17 Project Exec Env Priority :: WF17: Project-level executio... | PASS |\n2 tests, 2 passed, 0 failed\n==============================================================================\nE2E.Wf18 Container Clone :: E2E test for Workflow Example 18: Container wit...\n==============================================================================\nWF18 Container With Remote Repo Clone Trusted Profile :: Trusted-p... | PASS |\n------------------------------------------------------------------------------\nE2E.Wf18 Container Clone :: E2E test for Workflow Example 18: Cont... | PASS |\n1 test, 1 passed, 0 failed\n==============================================================================\nE2E | PASS |\n66 tests, 66 passed, 0 failed\n==============================================================================\nOutput: /app/output.xml\nLog: /app/log.html\nReport: /app/report.html"
|
|
} |