test(integration): workflow example 14 — server mode team collaboration (supervised profile) #778

Closed
opened 2026-03-12 19:40:46 +00:00 by freemo · 1 comment
Owner

Metadata

  • Commit Message: test(integration): workflow example 14 — server mode team collaboration (supervised profile)
  • Branch: test/int-wf14-server-mode

Background

Integration test for Specification Workflow Example 14: Server Mode — Team Collaboration. Exercises server mode configuration, diagnostics, namespace management, action publishing, and multi-user plan monitoring using mocked LLM providers and mocked server backend.

Runs within the standard nox -s integration_tests session using mocked LLM providers.

Expected Behavior

The integration test validates server mode operations with mocked server responses. Diagnostics pass, shared actions are published and listed, and plan monitoring shows multi-user activity.

Acceptance Criteria

  • Robot Framework test suite in robot/ directory (standard integration tests)
  • Test configures server mode and namespace settings
  • Test uses integration-appropriate mocking (mocked LLM providers, mocked server)
  • Test exercises diagnostics, action publishing, and namespace listing
  • Test exercises plan monitoring across namespace
  • Test passes via nox -s integration_tests
  • Coverage >=97% maintained

Subtasks

  • Write Robot Framework integration test suite for workflow example 14
  • Configure mocked LLM and server responses
  • Implement server mode workflow with namespace operations
  • Verify via nox -s integration_tests
  • Verify coverage >=97% via nox -s coverage_report
  • Run nox (all default sessions), fix any errors

Definition of Done

This issue is complete when:

  • All subtasks above are completed and checked off.
  • A Git commit is created where the first line of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details.
  • The commit is pushed to the remote on the branch matching the Branch in Metadata exactly.
  • The commit is submitted as a pull request to master, reviewed, and merged before this issue is marked done.
## Metadata - **Commit Message**: `test(integration): workflow example 14 — server mode team collaboration (supervised profile)` - **Branch**: `test/int-wf14-server-mode` ## Background Integration test for Specification Workflow Example 14: Server Mode — Team Collaboration. Exercises server mode configuration, diagnostics, namespace management, action publishing, and multi-user plan monitoring using mocked LLM providers and mocked server backend. Runs within the standard `nox -s integration_tests` session using mocked LLM providers. ## Expected Behavior The integration test validates server mode operations with mocked server responses. Diagnostics pass, shared actions are published and listed, and plan monitoring shows multi-user activity. ## Acceptance Criteria - [x] Robot Framework test suite in `robot/` directory (standard integration tests) - [x] Test configures server mode and namespace settings - [x] Test uses integration-appropriate mocking (mocked LLM providers, mocked server) - [x] Test exercises diagnostics, action publishing, and namespace listing - [x] Test exercises plan monitoring across namespace - [x] Test passes via `nox -s integration_tests` - [x] Coverage >=97% maintained ## Subtasks - [x] Write Robot Framework integration test suite for workflow example 14 - [x] Configure mocked LLM and server responses - [x] Implement server mode workflow with namespace operations - [x] Verify via `nox -s integration_tests` - [x] Verify coverage >=97% via `nox -s coverage_report` - [x] Run `nox` (all default sessions), fix any errors ## Definition of Done This issue is complete when: - All subtasks above are completed and checked off. - A Git commit is created where the **first line** of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details. - The commit is pushed to the remote on the branch matching the **Branch** in Metadata exactly. - The commit is submitted as a **pull request** to `master`, reviewed, and **merged** before this issue is marked done.
freemo added this to the v3.6.0 milestone 2026-03-12 19:40:47 +00:00
Member

Implementation Notes

Design Decisions

  • Test Structure: Created robot/wf14_server_mode_integration.robot (59 lines, 6 test cases) and robot/helper_wf14_server_mode.py (279 lines, 6 subcommands).
  • Server Mode Testing: Since no real server is available, tests validate server mode configuration, namespace management, and graceful handling of server connectivity failures.
  • Supervised Profile: Uses the supervised automation profile as the default for server mode collaboration.

Test Cases Implemented

  1. WF14 Server Mode Config - ConfigService set/get for server.url, server.token, core.namespace
  2. WF14 Diagnostics - Registry key checks, default resolution, supervised profile, graceful no-server handling
  3. WF14 Action Publish To Namespace - Namespaced action creation and listing
  4. WF14 Actor Publish To Namespace - Action with namespaced actor references
  5. WF14 Shared Action From Namespace - Multi-namespace action filtering and isolation
  6. WF14 Plan List Across Namespace - Plan listing with namespace filter, empty results handling

Quality Gates

  • Lint: PASSED
  • Typecheck: PASSED (0 errors)
  • Integration tests (WF14 suite): 6/6 PASSED
  • Unit tests: 378 features, 10700 scenarios PASSED
  • Coverage: 98% (>=97% threshold)

Key Code Locations

  • Robot suite: cleveragents-core/robot/wf14_server_mode_integration.robot (commit af7aef97)
  • Helper script: cleveragents-core/robot/helper_wf14_server_mode.py (commit af7aef97)
## Implementation Notes ### Design Decisions - **Test Structure**: Created `robot/wf14_server_mode_integration.robot` (59 lines, 6 test cases) and `robot/helper_wf14_server_mode.py` (279 lines, 6 subcommands). - **Server Mode Testing**: Since no real server is available, tests validate server mode configuration, namespace management, and graceful handling of server connectivity failures. - **Supervised Profile**: Uses the `supervised` automation profile as the default for server mode collaboration. ### Test Cases Implemented 1. **WF14 Server Mode Config** - ConfigService set/get for server.url, server.token, core.namespace 2. **WF14 Diagnostics** - Registry key checks, default resolution, supervised profile, graceful no-server handling 3. **WF14 Action Publish To Namespace** - Namespaced action creation and listing 4. **WF14 Actor Publish To Namespace** - Action with namespaced actor references 5. **WF14 Shared Action From Namespace** - Multi-namespace action filtering and isolation 6. **WF14 Plan List Across Namespace** - Plan listing with namespace filter, empty results handling ### Quality Gates - Lint: PASSED - Typecheck: PASSED (0 errors) - Integration tests (WF14 suite): 6/6 PASSED - Unit tests: 378 features, 10700 scenarios PASSED - Coverage: 98% (>=97% threshold) ### Key Code Locations - Robot suite: `cleveragents-core/robot/wf14_server_mode_integration.robot` (commit `af7aef97`) - Helper script: `cleveragents-core/robot/helper_wf14_server_mode.py` (commit `af7aef97`)
CoreRasurae added reference test/int-wf14-server-mode 2026-03-13 01:46:24 +00:00
Sign in to join this conversation.
No milestone
No project
No assignees
2 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Reference
cleveragents/cleveragents-core#778
No description provided.