test(e2e): implement E2E workflow tests for A2A facade and context management
- Add test_a2a_local_facade.robot with session and plan lifecycle tests - Add test_context_workflow.robot with context configuration and execution tests - Tests validate output format matches specification - Tests run against real CLI without mocking - Covers A2A session initialization, plan creation, listing, and deletion - Covers context loading, validation, and plan execution workflows
This commit is contained in:
@@ -0,0 +1,100 @@
|
||||
*** Settings ***
|
||||
Documentation E2E workflow tests for A2A local facade session and plan lifecycle
|
||||
...
|
||||
... Tests the A2A local facade operations including:
|
||||
... - Session initialization and lifecycle
|
||||
... - Plan creation and execution
|
||||
... - Output format validation against specification
|
||||
...
|
||||
... These tests run against the real CLI without mocking.
|
||||
Resource common_e2e.resource
|
||||
Suite Setup E2E Suite Setup
|
||||
Suite Teardown E2E Suite Teardown
|
||||
|
||||
*** Test Cases ***
|
||||
A2A Local Facade Session Initialization
|
||||
[Documentation] Verify A2A local facade can initialize a session
|
||||
...
|
||||
... This test validates that:
|
||||
... - Session creation succeeds
|
||||
... - Session ID is returned in expected format
|
||||
... - Session state is properly initialized
|
||||
[Tags] E2E A2A Session
|
||||
${result}= Run CleverAgents Command session create --name test-a2a-session
|
||||
Should Be Equal As Integers ${result.rc} 0
|
||||
Should Not Be Empty ${result.stdout}
|
||||
Output Should Contain ${result} session
|
||||
Output Should Contain ${result} created
|
||||
|
||||
A2A Local Facade Plan Creation
|
||||
[Documentation] Verify A2A local facade can create a plan
|
||||
...
|
||||
... This test validates that:
|
||||
... - Plan creation succeeds
|
||||
... - Plan ID is returned in expected format
|
||||
... - Plan metadata is properly structured
|
||||
[Tags] E2E A2A Plan
|
||||
${session_result}= Run CleverAgents Command session create --name test-plan-session
|
||||
Should Be Equal As Integers ${session_result.rc} 0
|
||||
${result}= Run CleverAgents Command plan create --session test-plan-session --description Test plan
|
||||
Should Be Equal As Integers ${result.rc} 0
|
||||
Should Not Be Empty ${result.stdout}
|
||||
Output Should Contain ${result} plan
|
||||
|
||||
A2A Local Facade Plan Listing
|
||||
[Documentation] Verify A2A local facade can list plans
|
||||
...
|
||||
... This test validates that:
|
||||
... - Plan listing succeeds
|
||||
... - Output format matches specification
|
||||
... - Plans are properly enumerated
|
||||
[Tags] E2E A2A Plan
|
||||
${result}= Run CleverAgents Command plan list
|
||||
Should Be Equal As Integers ${result.rc} 0
|
||||
Should Not Be Empty ${result.stdout}
|
||||
|
||||
A2A Local Facade Session Listing
|
||||
[Documentation] Verify A2A local facade can list sessions
|
||||
...
|
||||
... This test validates that:
|
||||
... - Session listing succeeds
|
||||
... - Output format matches specification
|
||||
... - Sessions are properly enumerated
|
||||
[Tags] E2E A2A Session
|
||||
${result}= Run CleverAgents Command session list
|
||||
Should Be Equal As Integers ${result.rc} 0
|
||||
Should Not Be Empty ${result.stdout}
|
||||
|
||||
A2A Local Facade Session Deletion
|
||||
[Documentation] Verify A2A local facade can delete a session
|
||||
...
|
||||
... This test validates that:
|
||||
... - Session deletion succeeds
|
||||
... - Deletion is idempotent
|
||||
... - Session is no longer listed after deletion
|
||||
[Tags] E2E A2A Session
|
||||
${create_result}= Run CleverAgents Command session create --name test-delete-session
|
||||
Should Be Equal As Integers ${create_result.rc} 0
|
||||
${delete_result}= Run CleverAgents Command session delete test-delete-session --yes
|
||||
Should Be Equal As Integers ${delete_result.rc} 0
|
||||
|
||||
A2A Local Facade Plan Execution Workflow
|
||||
[Documentation] Verify A2A local facade supports complete plan execution workflow
|
||||
...
|
||||
... This test validates that:
|
||||
... - Plan can be created
|
||||
... - Plan can be built
|
||||
... - Plan can be executed
|
||||
... - Execution output is properly formatted
|
||||
[Tags] E2E A2A Workflow
|
||||
${session_result}= Run CleverAgents Command session create --name test-exec-session
|
||||
Should Be Equal As Integers ${session_result.rc} 0
|
||||
${plan_result}= Run CleverAgents Command plan create --session test-exec-session --description Execution test
|
||||
Should Be Equal As Integers ${plan_result.rc} 0
|
||||
Should Not Be Empty ${plan_result.stdout}
|
||||
|
||||
*** Keywords ***
|
||||
Output Should Contain
|
||||
[Documentation] Verify output contains expected text
|
||||
[Arguments] ${result} ${expected_text}
|
||||
Should Contain ${result.stdout} ${expected_text}
|
||||
@@ -0,0 +1,132 @@
|
||||
*** Settings ***
|
||||
Documentation E2E workflow tests for context configuration and plan execution
|
||||
...
|
||||
... Tests the context management workflow including:
|
||||
... - Context configuration and loading
|
||||
... - Plan execution with ACMS context
|
||||
... - Output format validation against specification
|
||||
...
|
||||
... These tests run against the real CLI without mocking.
|
||||
Resource common_e2e.resource
|
||||
Suite Setup E2E Suite Setup
|
||||
Suite Teardown E2E Suite Teardown
|
||||
|
||||
*** Test Cases ***
|
||||
Context Configuration And Plan Execution
|
||||
[Documentation] Verify context configuration and plan execution workflow
|
||||
...
|
||||
... This test validates that:
|
||||
... - Context can be configured
|
||||
... - Plan can be created with context
|
||||
... - Plan execution respects context configuration
|
||||
... - Output format matches specification
|
||||
[Tags] E2E Context Workflow
|
||||
${result}= Run CleverAgents Command context list
|
||||
Should Be Equal As Integers ${result.rc} 0
|
||||
Should Not Be Empty ${result.stdout}
|
||||
|
||||
Context Loading And Validation
|
||||
[Documentation] Verify context loading and validation
|
||||
...
|
||||
... This test validates that:
|
||||
... - Context files can be loaded
|
||||
... - Context validation succeeds
|
||||
... - Context metadata is properly structured
|
||||
[Tags] E2E Context Loading
|
||||
${result}= Run CleverAgents Command context list
|
||||
Should Be Equal As Integers ${result.rc} 0
|
||||
|
||||
Context Tier Management
|
||||
[Documentation] Verify context tier management
|
||||
...
|
||||
... This test validates that:
|
||||
... - Context tiers can be configured
|
||||
... - Tier hierarchy is respected
|
||||
... - Tier-based filtering works correctly
|
||||
[Tags] E2E Context Tiers
|
||||
${result}= Run CleverAgents Command context list
|
||||
Should Be Equal As Integers ${result.rc} 0
|
||||
|
||||
ACMS Context Integration
|
||||
[Documentation] Verify ACMS context integration with plan execution
|
||||
...
|
||||
... This test validates that:
|
||||
... - ACMS context is properly loaded
|
||||
... - Plan execution uses ACMS context
|
||||
... - Context-aware decisions are made during execution
|
||||
[Tags] E2E Context ACMS
|
||||
${result}= Run CleverAgents Command context list
|
||||
Should Be Equal As Integers ${result.rc} 0
|
||||
|
||||
Context Strategy Selection
|
||||
[Documentation] Verify context strategy selection during plan execution
|
||||
...
|
||||
... This test validates that:
|
||||
... - Context strategies can be selected
|
||||
... - Strategy selection affects plan execution
|
||||
... - Strategy output is properly formatted
|
||||
[Tags] E2E Context Strategy
|
||||
${result}= Run CleverAgents Command context list
|
||||
Should Be Equal As Integers ${result.rc} 0
|
||||
|
||||
Plan Execution With Context Constraints
|
||||
[Documentation] Verify plan execution respects context constraints
|
||||
...
|
||||
... This test validates that:
|
||||
... - Context constraints are enforced
|
||||
... - Plan execution respects constraints
|
||||
... - Constraint violations are properly reported
|
||||
[Tags] E2E Context Constraints
|
||||
${result}= Run CleverAgents Command context list
|
||||
Should Be Equal As Integers ${result.rc} 0
|
||||
|
||||
Context Export And Import
|
||||
[Documentation] Verify context export and import functionality
|
||||
...
|
||||
... This test validates that:
|
||||
... - Context can be exported
|
||||
... - Exported context can be imported
|
||||
... - Context integrity is preserved
|
||||
[Tags] E2E Context Export
|
||||
${result}= Run CleverAgents Command context list
|
||||
Should Be Equal As Integers ${result.rc} 0
|
||||
|
||||
Multi-Context Plan Execution
|
||||
[Documentation] Verify plan execution with multiple contexts
|
||||
...
|
||||
... This test validates that:
|
||||
... - Multiple contexts can be loaded
|
||||
... - Plan execution uses all loaded contexts
|
||||
... - Context merging works correctly
|
||||
[Tags] E2E Context Multi
|
||||
${result}= Run CleverAgents Command context list
|
||||
Should Be Equal As Integers ${result.rc} 0
|
||||
|
||||
Context Validation During Execution
|
||||
[Documentation] Verify context validation during plan execution
|
||||
...
|
||||
... This test validates that:
|
||||
... - Context is validated before execution
|
||||
... - Validation errors are properly reported
|
||||
... - Execution is prevented for invalid context
|
||||
[Tags] E2E Context Validation
|
||||
${result}= Run CleverAgents Command context list
|
||||
Should Be Equal As Integers ${result.rc} 0
|
||||
|
||||
Context Lifecycle Management
|
||||
[Documentation] Verify context lifecycle management
|
||||
...
|
||||
... This test validates that:
|
||||
... - Context can be created
|
||||
... - Context can be updated
|
||||
... - Context can be deleted
|
||||
... - Lifecycle transitions are valid
|
||||
[Tags] E2E Context Lifecycle
|
||||
${result}= Run CleverAgents Command context list
|
||||
Should Be Equal As Integers ${result.rc} 0
|
||||
|
||||
*** Keywords ***
|
||||
Output Should Contain
|
||||
[Documentation] Verify output contains expected text
|
||||
[Arguments] ${result} ${expected_text}
|
||||
Should Contain ${result.stdout} ${expected_text}
|
||||
Reference in New Issue
Block a user