TEST-INFRA: [missing-test-levels] Add Robot and ASV tests for the infrastructure module #2000

Open
opened 2026-04-03 00:33:29 +00:00 by freemo · 0 comments
Owner

Metadata

  • Branch: test/infrastructure-robot-asv-tests
  • Commit Message: test(infrastructure): add Robot integration tests and ASV benchmarks for infrastructure module
  • Milestone: v3.8.0
  • Parent Epic: #1678

Description

The infrastructure module in src/cleveragents/infrastructure is missing the following test levels:

  • Robot integration tests (in robot/)
  • ASV performance benchmarks (in benchmarks/)

Per CONTRIBUTING.md's Multi-Level Testing Mandate, every module must have comprehensive test coverage at all three levels:

  • Behave unit tests (in features/) — may be tracked separately
  • Robot integration tests (in robot/) — missing
  • ASV performance benchmarks (in benchmarks/) — missing

The infrastructure module is responsible for the foundational cross-cutting concerns of the CleverAgents platform — including database persistence (repositories, unit of work, migration runner, engine cache), sandbox isolation strategies (copy-on-write, git worktree, overlay, transaction sandbox), and the event bus (reactive and logging bus). As a core infrastructure boundary, it warrants both integration-level verification and performance-level benchmarking to ensure correctness under realistic conditions and to guard against regressions in throughput and latency.

Subtasks

  • Audit the infrastructure module (src/cleveragents/infrastructure/) to identify all public integration points and performance-critical paths requiring Robot and ASV coverage.
  • Add Robot integration tests for the infrastructure module in robot/, covering key integration points (e.g., database repository operations, sandbox lifecycle, event bus dispatch). No mocking is permitted in Robot tests.
  • Add ASV performance benchmarks for the infrastructure module in benchmarks/, covering performance-critical paths (e.g., database query throughput, sandbox creation latency, event dispatch throughput).
  • Verify all new Robot tests pass via nox -e integration_tests.
  • Verify all new ASV benchmarks run successfully via nox.
  • Confirm coverage ≥ 97% via nox -e coverage_report.
  • Ensure all nox stages pass (nox).

Definition of Done

  • Robot integration tests exist under robot/ covering the infrastructure module's key integration points.
  • ASV benchmarks exist under benchmarks/ covering the infrastructure module's performance-critical paths.
  • No mocking is used in Robot integration tests.
  • The new tests provide adequate coverage for the infrastructure module.
  • The new tests pass in the CI pipeline.
  • All nox stages pass.
  • Coverage >= 97%
  • A Git commit is created where the first line of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details about the implementation.
  • The commit is pushed to the remote on the branch matching the Branch in Metadata exactly.
  • A pull request has been created, reviewed, and merged before this issue is marked done.

Automated by CleverAgents Bot
Supervisor: Test Infrastructure | Agent: ca-new-issue-creator

## Metadata - **Branch**: `test/infrastructure-robot-asv-tests` - **Commit Message**: `test(infrastructure): add Robot integration tests and ASV benchmarks for infrastructure module` - **Milestone**: v3.8.0 - **Parent Epic**: #1678 ## Description The `infrastructure` module in `src/cleveragents/infrastructure` is missing the following test levels: - **Robot** integration tests (in `robot/`) - **ASV** performance benchmarks (in `benchmarks/`) Per CONTRIBUTING.md's Multi-Level Testing Mandate, every module must have comprehensive test coverage at all three levels: - **Behave** unit tests (in `features/`) — may be tracked separately - **Robot** integration tests (in `robot/`) — **missing** - **ASV** performance benchmarks (in `benchmarks/`) — **missing** The `infrastructure` module is responsible for the foundational cross-cutting concerns of the CleverAgents platform — including database persistence (repositories, unit of work, migration runner, engine cache), sandbox isolation strategies (copy-on-write, git worktree, overlay, transaction sandbox), and the event bus (reactive and logging bus). As a core infrastructure boundary, it warrants both integration-level verification and performance-level benchmarking to ensure correctness under realistic conditions and to guard against regressions in throughput and latency. ## Subtasks - [ ] Audit the `infrastructure` module (`src/cleveragents/infrastructure/`) to identify all public integration points and performance-critical paths requiring Robot and ASV coverage. - [ ] Add Robot integration tests for the `infrastructure` module in `robot/`, covering key integration points (e.g., database repository operations, sandbox lifecycle, event bus dispatch). No mocking is permitted in Robot tests. - [ ] Add ASV performance benchmarks for the `infrastructure` module in `benchmarks/`, covering performance-critical paths (e.g., database query throughput, sandbox creation latency, event dispatch throughput). - [ ] Verify all new Robot tests pass via `nox -e integration_tests`. - [ ] Verify all new ASV benchmarks run successfully via `nox`. - [ ] Confirm coverage ≥ 97% via `nox -e coverage_report`. - [ ] Ensure all nox stages pass (`nox`). ## Definition of Done - [ ] Robot integration tests exist under `robot/` covering the `infrastructure` module's key integration points. - [ ] ASV benchmarks exist under `benchmarks/` covering the `infrastructure` module's performance-critical paths. - [ ] No mocking is used in Robot integration tests. - [ ] The new tests provide adequate coverage for the `infrastructure` module. - [ ] The new tests pass in the CI pipeline. - [ ] All nox stages pass. - [ ] Coverage >= 97% - [ ] A Git commit is created where the **first line** of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details about the implementation. - [ ] The commit is pushed to the remote on the branch matching the **Branch** in Metadata exactly. - [ ] A pull request has been created, reviewed, and merged before this issue is marked done. --- **Automated by CleverAgents Bot** Supervisor: Test Infrastructure | Agent: ca-new-issue-creator
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
cleveragents/cleveragents-core#2000
No description provided.