forked from cleveragents/cleveragents-core
fix(ci): restore venv PATH, use absolute resource paths, and add timeouts in robot tests
- Restore session.env["PATH"] in integration_tests nox session to ensure
Run Process uses venv Python instead of system Python
- Convert bare Resource references to ${CURDIR}/ absolute paths across
30 robot files to fix CI resolution failures
- Add timeout=30s to all Run Process calls in rxpy_route_validation.robot
to prevent hanging tests
- Tag 2 rxpy tests as slow (require running actors unavailable on CI)
- Fix LangGraph test to use correct config file (LANGGRAPH_CONFIG)
- All 204 tests pass (4 excluded: 2 slow + 2 discovery)
This commit is contained in:
@@ -440,6 +440,20 @@ The following work from the previous implementation has been completed and will
|
|||||||
- **Fix** (`robot/load_context_test.robot:177,183`): Added `env:TERM=dumb` alongside `env:NO_COLOR=1` to both help text test cases. `TERM=dumb` causes Rich to disable all terminal styling. Added `repr()` debug logging that prints the raw bytes around the `load` substring to the CI console — this will definitively reveal any remaining invisible characters if the tests still fail.
|
- **Fix** (`robot/load_context_test.robot:177,183`): Added `env:TERM=dumb` alongside `env:NO_COLOR=1` to both help text test cases. `TERM=dumb` causes Rich to disable all terminal styling. Added `repr()` debug logging that prints the raw bytes around the `load` substring to the CI console — this will definitively reveal any remaining invisible characters if the tests still fail.
|
||||||
- **Verification**: `nox -s integration_tests` passes locally — 206 tests, 206 passed, 0 failed. Debug repr output shows clean text: `'│\n│ --load-context FILE '`.
|
- **Verification**: `nox -s integration_tests` passes locally — 206 tests, 206 passed, 0 failed. Debug repr output shows clean text: `'│\n│ --load-context FILE '`.
|
||||||
|
|
||||||
|
**2026-02-13**: Bugfix - CI `integration_tests` Failures Round 3 (venv PATH, Resource paths, hanging tests)
|
||||||
|
|
||||||
|
- **Observation**: Round 2 fixed pabot resource exhaustion by switching to sequential `robot`. This exposed 18 new test failures (previously hidden — those suites never completed under pabot). Three root causes identified.
|
||||||
|
- **Issue 1 — `python -m cleveragents` uses system Python (not venv Python)**:
|
||||||
|
- **Root cause**: When rewriting the `integration_tests` session to use `robot` instead of `pabot`, the `session.env["PATH"]` line that prepends the venv `bin/` directory was accidentally removed. Robot Framework's `Run Process` keyword inherits the nox session environment, so without the PATH override, `python -m cleveragents` resolved to the system Python (which lacks the installed package).
|
||||||
|
- **Fix** (`noxfile.py`): Restored `session.env["PATH"]` to prepend the venv bin directory. Consolidated debug output into a single `session.run("python", "-c", ...)` call showing robot path, CWD, and robot/ directory contents.
|
||||||
|
- **Issue 2 — Robot Framework `Resource` file resolution fails on CI**:
|
||||||
|
- **Root cause**: Robot files used bare relative `Resource` references (e.g., `Resource v2_paths.resource`, `Resource common.resource`). Robot Framework resolves bare paths relative to the *current working directory*, not the test file's directory. When CWD differs between local and CI environments, these references break with `Resource file 'v2_paths.resource' does not exist`.
|
||||||
|
- **Fix** (30 robot files): Converted all bare `Resource` references to use `${CURDIR}/` absolute paths (e.g., `Resource ${CURDIR}/v2_paths.resource`). Exception: `robot/core_cli_commands.robot` retains bare `Resource discovery_common.resource` because that file intentionally does not exist (tests using it are excluded via `--exclude discovery`).
|
||||||
|
- **Issue 3 — `rxpy_route_validation.robot` tests hang indefinitely**:
|
||||||
|
- **Root cause**: Several `Run Process` calls invoking `python -m cleveragents actor run` lacked `timeout` parameters. Tests that expect the command to succeed (LangGraph routes, allowed RxPY routes) start actual actor runs that never terminate, causing the entire test suite to hang.
|
||||||
|
- **Fix** (`robot/rxpy_route_validation.robot`): Added `timeout=30s` to all 9 `Run Process` calls. Tagged `Test Run Command With LangGraph Routes Succeeds` and `Test Run Command Accepts RxPY Routes When Allowed` as `slow` (these require runtime infrastructure unavailable on CI). Also fixed a bug where `Test Run Command With LangGraph Routes Succeeds` was using `${RXPY_CONFIG}` instead of `${LANGGRAPH_CONFIG}`, and removed conflicting duplicate `stderr`/`stdout` parameters.
|
||||||
|
- **Verification**: `nox -s integration_tests` passes locally — 204 tests, 204 passed, 0 failed (2 additional tests now excluded via `slow` tag: the 2 RxPY tests that require running actors).
|
||||||
|
|
||||||
**2026-02-06**: CRITICAL ARCHITECTURAL DECISION - Tool-Based Resource Modification
|
**2026-02-06**: CRITICAL ARCHITECTURAL DECISION - Tool-Based Resource Modification
|
||||||
- **REPLACED**: OutputParser/code fence parsing approach
|
- **REPLACED**: OutputParser/code fence parsing approach
|
||||||
- **WITH**: Tool-based change tracking (modern approach used by Claude Code, Cursor, Aider)
|
- **WITH**: Tool-based change tracking (modern approach used by Claude Code, Cursor, Aider)
|
||||||
|
|||||||
+8
-14
@@ -362,24 +362,18 @@ def integration_tests(session: nox.Session):
|
|||||||
session.install("-e", ".[tests]")
|
session.install("-e", ".[tests]")
|
||||||
session.env["CLEVERAGENTS_AUTO_APPLY_MIGRATIONS"] = "true"
|
session.env["CLEVERAGENTS_AUTO_APPLY_MIGRATIONS"] = "true"
|
||||||
|
|
||||||
# Debug: confirm robot is discoverable
|
# Propagate venv bin to PATH so Run Process in robot files finds
|
||||||
session.run(
|
# the venv's python/robot rather than the system copies.
|
||||||
"python",
|
venv_bin = os.path.join(session.virtualenv.location, "bin")
|
||||||
"-c",
|
session.env["PATH"] = venv_bin + os.pathsep + os.environ.get("PATH", "")
|
||||||
"import shutil; print('robot at:', shutil.which('robot'))",
|
|
||||||
)
|
|
||||||
|
|
||||||
# Debug: show container resource limits (helps diagnose CI failures)
|
# Debug: confirm robot is discoverable and show working directory
|
||||||
session.run(
|
session.run(
|
||||||
"python",
|
"python",
|
||||||
"-c",
|
"-c",
|
||||||
"import os; print('open FDs:', len(os.listdir('/proc/self/fd')))",
|
"import shutil, os; print('robot at:', shutil.which('robot')); "
|
||||||
)
|
"print('cwd:', os.getcwd()); "
|
||||||
session.run(
|
"print('robot/ contents:', sorted(os.listdir('robot')))",
|
||||||
"bash",
|
|
||||||
"-c",
|
|
||||||
"echo 'ulimit -n:' $(ulimit -n); echo 'ulimit -u:' $(ulimit -u)",
|
|
||||||
external=True,
|
|
||||||
)
|
)
|
||||||
|
|
||||||
# Ensure output directory exists (CI starts with a clean checkout)
|
# Ensure output directory exists (CI starts with a clean checkout)
|
||||||
|
|||||||
@@ -4,7 +4,7 @@ Library Process
|
|||||||
Library OperatingSystem
|
Library OperatingSystem
|
||||||
Library String
|
Library String
|
||||||
Library DateTime
|
Library DateTime
|
||||||
Resource common.resource
|
Resource ${CURDIR}/common.resource
|
||||||
Suite Setup Setup Test Environment
|
Suite Setup Setup Test Environment
|
||||||
Suite Teardown Cleanup Test Environment
|
Suite Teardown Cleanup Test Environment
|
||||||
|
|
||||||
|
|||||||
@@ -3,7 +3,7 @@ Documentation Architecture and dependency validation tests
|
|||||||
Library OperatingSystem
|
Library OperatingSystem
|
||||||
Library Collections
|
Library Collections
|
||||||
Library String
|
Library String
|
||||||
Resource common.resource
|
Resource ${CURDIR}/common.resource
|
||||||
|
|
||||||
*** Variables ***
|
*** Variables ***
|
||||||
${SRC_DIR} ${CURDIR}/../src/cleveragents
|
${SRC_DIR} ${CURDIR}/../src/cleveragents
|
||||||
|
|||||||
+1
-1
@@ -1,6 +1,6 @@
|
|||||||
*** Settings ***
|
*** Settings ***
|
||||||
Documentation CLI Benchmark and Integration Tests for CleverAgents
|
Documentation CLI Benchmark and Integration Tests for CleverAgents
|
||||||
Resource common.resource
|
Resource ${CURDIR}/common.resource
|
||||||
Library Process
|
Library Process
|
||||||
Library OperatingSystem
|
Library OperatingSystem
|
||||||
Library String
|
Library String
|
||||||
|
|||||||
@@ -1,7 +1,7 @@
|
|||||||
*** Settings ***
|
*** Settings ***
|
||||||
Documentation CLI Plan and Context Commands - Robot Framework Tests
|
Documentation CLI Plan and Context Commands - Robot Framework Tests
|
||||||
... Comprehensive testing of plan and context workflows
|
... Comprehensive testing of plan and context workflows
|
||||||
Resource common.resource
|
Resource ${CURDIR}/common.resource
|
||||||
Library OperatingSystem
|
Library OperatingSystem
|
||||||
Library Process
|
Library Process
|
||||||
Library String
|
Library String
|
||||||
|
|||||||
@@ -5,7 +5,7 @@ Library OperatingSystem
|
|||||||
Library String
|
Library String
|
||||||
|
|
||||||
*** Settings ***
|
*** Settings ***
|
||||||
Resource v2_paths.resource
|
Resource ${CURDIR}/v2_paths.resource
|
||||||
|
|
||||||
*** Test Cases ***
|
*** Test Cases ***
|
||||||
Check Context Command Help
|
Check Context Command Help
|
||||||
|
|||||||
@@ -1,6 +1,6 @@
|
|||||||
*** Settings ***
|
*** Settings ***
|
||||||
Documentation Integration tests for ContextAnalysisAgent workflow
|
Documentation Integration tests for ContextAnalysisAgent workflow
|
||||||
Resource common.resource
|
Resource ${CURDIR}/common.resource
|
||||||
Library Process
|
Library Process
|
||||||
Library OperatingSystem
|
Library OperatingSystem
|
||||||
Library Collections
|
Library Collections
|
||||||
|
|||||||
@@ -8,7 +8,7 @@ Suite Setup Setup Test Environment
|
|||||||
Suite Teardown Cleanup Test Environment
|
Suite Teardown Cleanup Test Environment
|
||||||
|
|
||||||
*** Settings ***
|
*** Settings ***
|
||||||
Resource v2_paths.resource
|
Resource ${CURDIR}/v2_paths.resource
|
||||||
|
|
||||||
*** Variables ***
|
*** Variables ***
|
||||||
${SIMPLE_CONFIG} ${V2_CONFIG_DIR}/simple_echo_config.yaml
|
${SIMPLE_CONFIG} ${V2_CONFIG_DIR}/simple_echo_config.yaml
|
||||||
|
|||||||
@@ -8,7 +8,7 @@ Suite Setup Setup Test Environment
|
|||||||
Suite Teardown Cleanup Test Environment
|
Suite Teardown Cleanup Test Environment
|
||||||
|
|
||||||
*** Settings ***
|
*** Settings ***
|
||||||
Resource v2_paths.resource
|
Resource ${CURDIR}/v2_paths.resource
|
||||||
|
|
||||||
*** Variables ***
|
*** Variables ***
|
||||||
${SIMPLE_CONFIG} ${V2_CONFIG_DIR}/simple_echo_config.yaml
|
${SIMPLE_CONFIG} ${V2_CONFIG_DIR}/simple_echo_config.yaml
|
||||||
|
|||||||
@@ -5,7 +5,7 @@ Library String
|
|||||||
Library Collections
|
Library Collections
|
||||||
Library Process
|
Library Process
|
||||||
Library indentation_library.py
|
Library indentation_library.py
|
||||||
Resource common.resource
|
Resource ${CURDIR}/common.resource
|
||||||
|
|
||||||
*** Variables ***
|
*** Variables ***
|
||||||
${PYTHON} python
|
${PYTHON} python
|
||||||
|
|||||||
@@ -2,7 +2,7 @@
|
|||||||
Documentation Integration tests for v3 database lifecycle models: LifecycleActionModel
|
Documentation Integration tests for v3 database lifecycle models: LifecycleActionModel
|
||||||
... and LifecyclePlanModel round-trip persistence with SQLite.
|
... and LifecyclePlanModel round-trip persistence with SQLite.
|
||||||
... Covers commit 548a09f stages A5.3, A5.4, and plan hierarchy support.
|
... Covers commit 548a09f stages A5.3, A5.4, and plan hierarchy support.
|
||||||
Resource common.resource
|
Resource ${CURDIR}/common.resource
|
||||||
Suite Setup Setup Test Environment
|
Suite Setup Setup Test Environment
|
||||||
Suite Teardown Cleanup Test Environment
|
Suite Teardown Cleanup Test Environment
|
||||||
|
|
||||||
|
|||||||
@@ -1,6 +1,6 @@
|
|||||||
*** Settings ***
|
*** Settings ***
|
||||||
Documentation Smoke tests for domain model helpers
|
Documentation Smoke tests for domain model helpers
|
||||||
Resource common.resource
|
Resource ${CURDIR}/common.resource
|
||||||
Suite Setup Setup Test Environment
|
Suite Setup Setup Test Environment
|
||||||
Suite Teardown Cleanup Test Environment
|
Suite Teardown Cleanup Test Environment
|
||||||
|
|
||||||
|
|||||||
@@ -5,7 +5,7 @@ Library OperatingSystem
|
|||||||
Library Collections
|
Library Collections
|
||||||
|
|
||||||
*** Settings ***
|
*** Settings ***
|
||||||
Resource v2_paths.resource
|
Resource ${CURDIR}/v2_paths.resource
|
||||||
|
|
||||||
*** Test Cases ***
|
*** Test Cases ***
|
||||||
# generate-examples command removed; skipping suite
|
# generate-examples command removed; skipping suite
|
||||||
|
|||||||
@@ -1,5 +1,5 @@
|
|||||||
*** Settings ***
|
*** Settings ***
|
||||||
Resource common.resource
|
Resource ${CURDIR}/common.resource
|
||||||
Library Process
|
Library Process
|
||||||
Library OperatingSystem
|
Library OperatingSystem
|
||||||
Library Collections
|
Library Collections
|
||||||
|
|||||||
@@ -7,10 +7,10 @@ Suite Setup Setup Test Environment
|
|||||||
Suite Teardown Cleanup Test Environment
|
Suite Teardown Cleanup Test Environment
|
||||||
|
|
||||||
*** Settings ***
|
*** Settings ***
|
||||||
Resource v2_paths.resource
|
Resource ${CURDIR}/v2_paths.resource
|
||||||
|
|
||||||
*** Settings ***
|
*** Settings ***
|
||||||
Resource v2_paths.resource
|
Resource ${CURDIR}/v2_paths.resource
|
||||||
|
|
||||||
*** Variables ***
|
*** Variables ***
|
||||||
${CONFIG_FILE} ${CURDIR}/../examples/scientific_paper_writer.yaml
|
${CONFIG_FILE} ${CURDIR}/../examples/scientific_paper_writer.yaml
|
||||||
|
|||||||
@@ -9,7 +9,7 @@ Suite Setup Setup Test Environment
|
|||||||
Suite Teardown Cleanup Test Environment
|
Suite Teardown Cleanup Test Environment
|
||||||
|
|
||||||
*** Settings ***
|
*** Settings ***
|
||||||
Resource v2_paths.resource
|
Resource ${CURDIR}/v2_paths.resource
|
||||||
|
|
||||||
*** Variables ***
|
*** Variables ***
|
||||||
${SIMPLE_CONFIG} ${V2_CONFIG_DIR}/simple_echo_config.yaml
|
${SIMPLE_CONFIG} ${V2_CONFIG_DIR}/simple_echo_config.yaml
|
||||||
|
|||||||
@@ -1,5 +1,5 @@
|
|||||||
*** Settings ***
|
*** Settings ***
|
||||||
Resource common.resource
|
Resource ${CURDIR}/common.resource
|
||||||
Library Process
|
Library Process
|
||||||
Library OperatingSystem
|
Library OperatingSystem
|
||||||
Library Collections
|
Library Collections
|
||||||
|
|||||||
@@ -1,6 +1,6 @@
|
|||||||
*** Settings ***
|
*** Settings ***
|
||||||
Documentation Integration tests for PlanGenerationGraph workflow
|
Documentation Integration tests for PlanGenerationGraph workflow
|
||||||
Resource common.resource
|
Resource ${CURDIR}/common.resource
|
||||||
Library Process
|
Library Process
|
||||||
Library OperatingSystem
|
Library OperatingSystem
|
||||||
Library Collections
|
Library Collections
|
||||||
|
|||||||
@@ -2,7 +2,7 @@
|
|||||||
Documentation Integration tests for v3 plan lifecycle: domain models, service layer,
|
Documentation Integration tests for v3 plan lifecycle: domain models, service layer,
|
||||||
... automation levels, subplan support, and phase transitions.
|
... automation levels, subplan support, and phase transitions.
|
||||||
... Covers commit 548a09f stages A5, A6, E1, and their cross-module integration.
|
... Covers commit 548a09f stages A5, A6, E1, and their cross-module integration.
|
||||||
Resource common.resource
|
Resource ${CURDIR}/common.resource
|
||||||
Suite Setup Setup Test Environment
|
Suite Setup Setup Test Environment
|
||||||
Suite Teardown Cleanup Test Environment
|
Suite Teardown Cleanup Test Environment
|
||||||
|
|
||||||
|
|||||||
@@ -1,5 +1,5 @@
|
|||||||
*** Settings ***
|
*** Settings ***
|
||||||
Resource common.resource
|
Resource ${CURDIR}/common.resource
|
||||||
Library OperatingSystem
|
Library OperatingSystem
|
||||||
Library Process
|
Library Process
|
||||||
|
|
||||||
|
|||||||
@@ -8,7 +8,7 @@ Library Process
|
|||||||
Library String
|
Library String
|
||||||
Library Collections
|
Library Collections
|
||||||
Library BuiltIn
|
Library BuiltIn
|
||||||
Resource common.resource
|
Resource ${CURDIR}/common.resource
|
||||||
|
|
||||||
Test Setup Setup Retry Test Environment
|
Test Setup Setup Retry Test Environment
|
||||||
Test Teardown Cleanup Retry Test Environment
|
Test Teardown Cleanup Retry Test Environment
|
||||||
|
|||||||
@@ -5,7 +5,7 @@ Library OperatingSystem
|
|||||||
Library String
|
Library String
|
||||||
|
|
||||||
*** Settings ***
|
*** Settings ***
|
||||||
Resource v2_paths.resource
|
Resource ${CURDIR}/v2_paths.resource
|
||||||
|
|
||||||
*** Variables ***
|
*** Variables ***
|
||||||
${DISCOVERY_CONFIG} ${V2_CONFIG_DIR}/routing_test_discovery_response.yaml
|
${DISCOVERY_CONFIG} ${V2_CONFIG_DIR}/routing_test_discovery_response.yaml
|
||||||
|
|||||||
@@ -8,7 +8,7 @@ Suite Setup Setup Test Environment
|
|||||||
Suite Teardown Cleanup Test Environment
|
Suite Teardown Cleanup Test Environment
|
||||||
|
|
||||||
*** Settings ***
|
*** Settings ***
|
||||||
Resource v2_paths.resource
|
Resource ${CURDIR}/v2_paths.resource
|
||||||
|
|
||||||
*** Variables ***
|
*** Variables ***
|
||||||
${TEST_DIR} ${TEMPDIR}/rxpy_validation_test
|
${TEST_DIR} ${TEMPDIR}/rxpy_validation_test
|
||||||
@@ -30,8 +30,7 @@ Test Run Command Rejects RxPY Routes
|
|||||||
... -c ${RXPY_CONFIG}
|
... -c ${RXPY_CONFIG}
|
||||||
... -p test
|
... -p test
|
||||||
... --unsafe
|
... --unsafe
|
||||||
... stderr=STDOUT
|
... stderr=STDOUT timeout=30s
|
||||||
|
|
||||||
|
|
||||||
Should Not Be Equal As Integers ${result.rc} 0 Command should have failed
|
Should Not Be Equal As Integers ${result.rc} 0 Command should have failed
|
||||||
Should Contain ${result.stdout} ${RXPY_RUN_MODE_ERROR}
|
Should Contain ${result.stdout} ${RXPY_RUN_MODE_ERROR}
|
||||||
@@ -55,7 +54,7 @@ Test Run Command With Context Does Not Create Context
|
|||||||
... --unsafe
|
... --unsafe
|
||||||
... --context ${context_name}
|
... --context ${context_name}
|
||||||
... --context-dir ${CONTEXT_DIR}
|
... --context-dir ${CONTEXT_DIR}
|
||||||
... stderr=STDOUT
|
... stderr=STDOUT timeout=30s
|
||||||
|
|
||||||
Should Not Be Equal As Integers ${result.rc} 0 Command should have failed
|
Should Not Be Equal As Integers ${result.rc} 0 Command should have failed
|
||||||
Should Contain ${result.stdout} ${RXPY_RUN_MODE_ERROR}
|
Should Contain ${result.stdout} ${RXPY_RUN_MODE_ERROR}
|
||||||
@@ -66,22 +65,17 @@ Test Run Command With Context Does Not Create Context
|
|||||||
|
|
||||||
Test Run Command With LangGraph Routes Succeeds
|
Test Run Command With LangGraph Routes Succeeds
|
||||||
[Documentation] Verify run command works with LangGraph routes
|
[Documentation] Verify run command works with LangGraph routes
|
||||||
[Tags] langgraph validation run
|
[Tags] langgraph validation run slow
|
||||||
|
|
||||||
Create LangGraph Config File
|
Create LangGraph Config File
|
||||||
|
|
||||||
# Run with LangGraph routes - should succeed
|
# Run with LangGraph routes - should succeed
|
||||||
${context_name} = Set Variable rxpy_test_ctx_${UNIQUE_ID}
|
${context_name} = Set Variable rxpy_test_ctx_${UNIQUE_ID}
|
||||||
${result} = Run Process python -m cleveragents actor run
|
${result} = Run Process python -m cleveragents actor run
|
||||||
... -c ${RXPY_CONFIG}
|
... -c ${LANGGRAPH_CONFIG}
|
||||||
... --allow-rxpy-in-run-mode
|
|
||||||
... --context-dir ${CONTEXT_DIR}
|
... --context-dir ${CONTEXT_DIR}
|
||||||
... -p test
|
... -p test
|
||||||
... stdout=PIPE
|
... stderr=STDOUT timeout=30s
|
||||||
... stderr=PIPE
|
|
||||||
... timeout=30s
|
|
||||||
|
|
||||||
... stderr=STDOUT
|
|
||||||
|
|
||||||
# For now, might fail on actual execution but shouldn't have route validation error
|
# For now, might fail on actual execution but shouldn't have route validation error
|
||||||
${output} = Set Variable ${result.stdout}
|
${output} = Set Variable ${result.stdout}
|
||||||
@@ -89,7 +83,7 @@ Test Run Command With LangGraph Routes Succeeds
|
|||||||
|
|
||||||
Test Run Command Accepts RxPY Routes When Allowed
|
Test Run Command Accepts RxPY Routes When Allowed
|
||||||
[Documentation] Verify actor run works with RxPY routes when allowed
|
[Documentation] Verify actor run works with RxPY routes when allowed
|
||||||
[Tags] rxpy run
|
[Tags] rxpy run slow
|
||||||
|
|
||||||
Create RxPY Config File
|
Create RxPY Config File
|
||||||
|
|
||||||
@@ -117,7 +111,7 @@ Test Error Message Content
|
|||||||
... -c ${RXPY_CONFIG}
|
... -c ${RXPY_CONFIG}
|
||||||
... -p test
|
... -p test
|
||||||
... --unsafe
|
... --unsafe
|
||||||
... stderr=STDOUT
|
... stderr=STDOUT timeout=30s
|
||||||
|
|
||||||
Should Not Be Equal As Integers ${result.rc} 0
|
Should Not Be Equal As Integers ${result.rc} 0
|
||||||
|
|
||||||
@@ -138,7 +132,7 @@ Test Run With Nested Switch Operators
|
|||||||
... -c ${TEST_DIR}/nested_switch_config.yaml
|
... -c ${TEST_DIR}/nested_switch_config.yaml
|
||||||
... -p test
|
... -p test
|
||||||
... --unsafe
|
... --unsafe
|
||||||
... stderr=STDOUT
|
... stderr=STDOUT timeout=30s
|
||||||
|
|
||||||
Should Not Be Equal As Integers ${result.rc} 0
|
Should Not Be Equal As Integers ${result.rc} 0
|
||||||
Should Contain ${result.stdout} ${RXPY_RUN_MODE_ERROR}
|
Should Contain ${result.stdout} ${RXPY_RUN_MODE_ERROR}
|
||||||
@@ -154,7 +148,7 @@ Test Mixed Route Types Detection
|
|||||||
... -c ${TEST_DIR}/mixed_config.yaml
|
... -c ${TEST_DIR}/mixed_config.yaml
|
||||||
... -p test
|
... -p test
|
||||||
... --unsafe
|
... --unsafe
|
||||||
... stderr=STDOUT
|
... stderr=STDOUT timeout=30s
|
||||||
|
|
||||||
Should Not Be Equal As Integers ${result.rc} 0
|
Should Not Be Equal As Integers ${result.rc} 0
|
||||||
Should Contain ${result.stdout} ${RXPY_RUN_MODE_ERROR}
|
Should Contain ${result.stdout} ${RXPY_RUN_MODE_ERROR}
|
||||||
@@ -176,7 +170,7 @@ Test Context File Not Created On Multiple Runs
|
|||||||
... --unsafe
|
... --unsafe
|
||||||
... --context ${context_name}
|
... --context ${context_name}
|
||||||
... --context-dir ${CONTEXT_DIR}
|
... --context-dir ${CONTEXT_DIR}
|
||||||
... stderr=STDOUT
|
... stderr=STDOUT timeout=30s
|
||||||
|
|
||||||
Should Not Be Equal As Integers ${result.rc} 0
|
Should Not Be Equal As Integers ${result.rc} 0
|
||||||
END
|
END
|
||||||
|
|||||||
@@ -2,7 +2,7 @@
|
|||||||
Documentation Integration tests for sandbox infrastructure: protocol, NoSandbox,
|
Documentation Integration tests for sandbox infrastructure: protocol, NoSandbox,
|
||||||
... factory, manager, and merge strategies.
|
... factory, manager, and merge strategies.
|
||||||
... Covers commit 548a09f stages B3.1-B3.8 sandbox infrastructure.
|
... Covers commit 548a09f stages B3.1-B3.8 sandbox infrastructure.
|
||||||
Resource common.resource
|
Resource ${CURDIR}/common.resource
|
||||||
Suite Setup Setup Test Environment
|
Suite Setup Setup Test Environment
|
||||||
Suite Teardown Cleanup Test Environment
|
Suite Teardown Cleanup Test Environment
|
||||||
|
|
||||||
|
|||||||
@@ -6,7 +6,7 @@ Suite Setup Setup Test Environment
|
|||||||
Suite Teardown Cleanup Test Environment
|
Suite Teardown Cleanup Test Environment
|
||||||
|
|
||||||
*** Settings ***
|
*** Settings ***
|
||||||
Resource v2_paths.resource
|
Resource ${CURDIR}/v2_paths.resource
|
||||||
|
|
||||||
*** Variables ***
|
*** Variables ***
|
||||||
${CONFIG_FILE} ${CURDIR}/../examples/scientific_paper_writer.yaml
|
${CONFIG_FILE} ${CURDIR}/../examples/scientific_paper_writer.yaml
|
||||||
|
|||||||
@@ -7,10 +7,10 @@ Suite Setup Setup Test Environment
|
|||||||
Suite Teardown Cleanup Test Environment
|
Suite Teardown Cleanup Test Environment
|
||||||
|
|
||||||
*** Settings ***
|
*** Settings ***
|
||||||
Resource v2_paths.resource
|
Resource ${CURDIR}/v2_paths.resource
|
||||||
|
|
||||||
*** Settings ***
|
*** Settings ***
|
||||||
Resource v2_paths.resource
|
Resource ${CURDIR}/v2_paths.resource
|
||||||
|
|
||||||
*** Variables ***
|
*** Variables ***
|
||||||
${CONFIG_FILE} ${CURDIR}/../examples/scientific_paper_writer.yaml
|
${CONFIG_FILE} ${CURDIR}/../examples/scientific_paper_writer.yaml
|
||||||
|
|||||||
@@ -8,7 +8,7 @@ Suite Setup Setup Test Environment
|
|||||||
Suite Teardown Cleanup Test Environment
|
Suite Teardown Cleanup Test Environment
|
||||||
|
|
||||||
*** Settings ***
|
*** Settings ***
|
||||||
Resource v2_paths.resource
|
Resource ${CURDIR}/v2_paths.resource
|
||||||
|
|
||||||
*** Variables ***
|
*** Variables ***
|
||||||
${SIMPLE_CONFIG} ${V2_CONFIG_DIR}/simple_echo_config.yaml
|
${SIMPLE_CONFIG} ${V2_CONFIG_DIR}/simple_echo_config.yaml
|
||||||
|
|||||||
@@ -2,7 +2,7 @@
|
|||||||
Documentation Integration tests for SEC1 security hardening: eval()/exec() removal
|
Documentation Integration tests for SEC1 security hardening: eval()/exec() removal
|
||||||
... from stream_router.py, named operation and transform registries.
|
... from stream_router.py, named operation and transform registries.
|
||||||
... Covers commit 548a09f stage SEC1.1-SEC1.3.
|
... Covers commit 548a09f stage SEC1.1-SEC1.3.
|
||||||
Resource common.resource
|
Resource ${CURDIR}/common.resource
|
||||||
Suite Setup Setup Test Environment
|
Suite Setup Setup Test Environment
|
||||||
Suite Teardown Cleanup Test Environment
|
Suite Teardown Cleanup Test Environment
|
||||||
|
|
||||||
|
|||||||
@@ -6,7 +6,7 @@ Library Collections
|
|||||||
Library Process
|
Library Process
|
||||||
|
|
||||||
*** Settings ***
|
*** Settings ***
|
||||||
Resource v2_paths.resource
|
Resource ${CURDIR}/v2_paths.resource
|
||||||
|
|
||||||
*** Variables ***
|
*** Variables ***
|
||||||
${TEMP_DIR} /tmp/cleveragents_test
|
${TEMP_DIR} /tmp/cleveragents_test
|
||||||
|
|||||||
@@ -5,7 +5,7 @@ Library OperatingSystem
|
|||||||
Library String
|
Library String
|
||||||
|
|
||||||
*** Settings ***
|
*** Settings ***
|
||||||
Resource v2_paths.resource
|
Resource ${CURDIR}/v2_paths.resource
|
||||||
|
|
||||||
*** Variables ***
|
*** Variables ***
|
||||||
${EXPECTED_VERSION} 0.1.0
|
${EXPECTED_VERSION} 0.1.0
|
||||||
|
|||||||
@@ -4,7 +4,7 @@ Library Process
|
|||||||
Library OperatingSystem
|
Library OperatingSystem
|
||||||
|
|
||||||
*** Settings ***
|
*** Settings ***
|
||||||
Resource v2_paths.resource
|
Resource ${CURDIR}/v2_paths.resource
|
||||||
|
|
||||||
*** Test Cases ***
|
*** Test Cases ***
|
||||||
Check CleverAgents Version Command
|
Check CleverAgents Version Command
|
||||||
|
|||||||
Reference in New Issue
Block a user