freemo
34f9a587cf
CI / benchmark-publish (pull_request) Has been skipped
CI / lint (pull_request) Successful in 16s
CI / build (pull_request) Successful in 15s
CI / quality (pull_request) Successful in 18s
CI / security (pull_request) Successful in 33s
CI / typecheck (pull_request) Successful in 38s
CI / unit_tests (pull_request) Successful in 3m23s
CI / docker (pull_request) Successful in 39s
CI / integration_tests (pull_request) Successful in 4m14s
CI / coverage (pull_request) Successful in 4m18s
CI / lint (push) Successful in 13s
CI / build (push) Successful in 15s
CI / quality (push) Successful in 17s
CI / typecheck (push) Successful in 33s
CI / benchmark-regression (push) Has been skipped
CI / security (push) Successful in 47s
CI / unit_tests (push) Successful in 2m12s
CI / docker (push) Successful in 39s
CI / integration_tests (push) Successful in 3m15s
CI / coverage (push) Successful in 5m5s
CI / benchmark-publish (push) Has been cancelled
CI / benchmark-regression (pull_request) Successful in 30m5s
Add production-quality Phase 1 pipeline components for the ACMS Context Assembly Pipeline: - ConfidenceWeightedSelector: strategy selection with preference boosting and confidence-based ranking - ProportionalBudgetAllocator: proportional token budget distribution with min_useful_budget enforcement and largest-remainder rounding - ParallelStrategyExecutor: concurrent strategy execution via ThreadPoolExecutor with per-strategy timeouts and circuit breaking - CircuitBreaker: per-strategy failure tracking with configurable threshold and explicit reset - ContextAssemblyPipeline: extends ACMSPipeline with Phase 1 production components and per-stage timing (StageTimings) Includes 28 Behave BDD scenarios, 9 Robot Framework integration tests, and ASV benchmarks for all components. ISSUES CLOSED: #539
82 lines
3.7 KiB
Plaintext
82 lines
3.7 KiB
Plaintext
*** Settings ***
|
|
Documentation Integration smoke tests for ACMS Pipeline Orchestrator and Phase 1 components
|
|
Resource ${CURDIR}/common.resource
|
|
Suite Setup Setup Test Environment
|
|
Suite Teardown Cleanup Test Environment
|
|
|
|
*** Variables ***
|
|
${HELPER} ${CURDIR}/helper_acms_pipeline_orchestrator.py
|
|
|
|
*** Test Cases ***
|
|
ConfidenceWeightedSelector Selects Strategies
|
|
[Documentation] ConfidenceWeightedSelector selects and ranks strategies by confidence
|
|
${result}= Run Process ${PYTHON} ${HELPER} cws-select cwd=${WORKSPACE}
|
|
Log ${result.stdout}
|
|
Log ${result.stderr}
|
|
Should Be Equal As Integers ${result.rc} 0
|
|
Should Contain ${result.stdout} cws-select-ok
|
|
|
|
ConfidenceWeightedSelector Boosts Preferred
|
|
[Documentation] ConfidenceWeightedSelector boosts preferred strategies
|
|
${result}= Run Process ${PYTHON} ${HELPER} cws-preferred cwd=${WORKSPACE}
|
|
Log ${result.stdout}
|
|
Log ${result.stderr}
|
|
Should Be Equal As Integers ${result.rc} 0
|
|
Should Contain ${result.stdout} cws-preferred-ok
|
|
|
|
ProportionalBudgetAllocator Distributes Budget
|
|
[Documentation] ProportionalBudgetAllocator distributes tokens proportionally
|
|
${result}= Run Process ${PYTHON} ${HELPER} pba-proportional cwd=${WORKSPACE}
|
|
Log ${result.stdout}
|
|
Log ${result.stderr}
|
|
Should Be Equal As Integers ${result.rc} 0
|
|
Should Contain ${result.stdout} pba-proportional-ok
|
|
|
|
ProportionalBudgetAllocator MinBudget Enforcement
|
|
[Documentation] ProportionalBudgetAllocator enforces min_useful_budget
|
|
${result}= Run Process ${PYTHON} ${HELPER} pba-min-budget cwd=${WORKSPACE}
|
|
Log ${result.stdout}
|
|
Log ${result.stderr}
|
|
Should Be Equal As Integers ${result.rc} 0
|
|
Should Contain ${result.stdout} pba-min-budget-ok
|
|
|
|
CircuitBreaker Opens After Failures
|
|
[Documentation] CircuitBreaker opens circuit after consecutive failures
|
|
${result}= Run Process ${PYTHON} ${HELPER} cb-open cwd=${WORKSPACE}
|
|
Log ${result.stdout}
|
|
Log ${result.stderr}
|
|
Should Be Equal As Integers ${result.rc} 0
|
|
Should Contain ${result.stdout} cb-open-ok
|
|
|
|
CircuitBreaker Resets On Success
|
|
[Documentation] CircuitBreaker resets on success
|
|
${result}= Run Process ${PYTHON} ${HELPER} cb-reset cwd=${WORKSPACE}
|
|
Log ${result.stdout}
|
|
Log ${result.stderr}
|
|
Should Be Equal As Integers ${result.rc} 0
|
|
Should Contain ${result.stdout} cb-reset-ok
|
|
|
|
ParallelStrategyExecutor Executes Strategy
|
|
[Documentation] ParallelStrategyExecutor invokes strategy and returns fragments
|
|
${result}= Run Process ${PYTHON} ${HELPER} executor-run cwd=${WORKSPACE}
|
|
Log ${result.stdout}
|
|
Log ${result.stderr}
|
|
Should Be Equal As Integers ${result.rc} 0
|
|
Should Contain ${result.stdout} executor-run-ok
|
|
|
|
ContextAssemblyPipeline Assemble With Timings
|
|
[Documentation] Full pipeline assembly with timing metadata
|
|
${result}= Run Process ${PYTHON} ${HELPER} pipeline-assemble cwd=${WORKSPACE}
|
|
Log ${result.stdout}
|
|
Log ${result.stderr}
|
|
Should Be Equal As Integers ${result.rc} 0
|
|
Should Contain ${result.stdout} pipeline-assemble-ok
|
|
|
|
ContextAssemblyPipeline Custom Components
|
|
[Documentation] Pipeline accepts custom Phase 1 components
|
|
${result}= Run Process ${PYTHON} ${HELPER} pipeline-custom cwd=${WORKSPACE}
|
|
Log ${result.stdout}
|
|
Log ${result.stderr}
|
|
Should Be Equal As Integers ${result.rc} 0
|
|
Should Contain ${result.stdout} pipeline-custom-ok
|