test(e2e): create M7 (v3.6.0) acceptance test suite — robot/e2e/m7_acceptance.robot #3375

Open
opened 2026-04-05 14:42:46 +00:00 by freemo · 1 comment
Owner

Metadata

  • Branch: test/v3.6.0/m7-acceptance-tests
  • Commit Message: test(e2e): create M7 (v3.6.0) acceptance test suite
  • Milestone: v3.6.0
  • Parent Epic: #3374

Background

Issue #3328 identified that robot/e2e/m7_acceptance.robot is missing. M1, M2, M5, and M6 all have acceptance tests but M7 (v3.6.0) does not. The M7 acceptance test should verify the key capabilities of the v3.6.0 milestone: advanced context strategies, additional LLM providers, additional resource types, A2A protocol compliance, container tool execution, cost/session budgets, and safety profiles.

Expected Behavior

robot/e2e/m7_acceptance.robot exists and contains test cases that verify:

  • Advanced context strategies are functional
  • Additional LLM providers (Cohere, Groq) can be configured
  • Additional resource types (cloud, database hierarchy) work
  • A2A protocol compliance (JSON-RPC 2.0 framing)
  • Cost/session budget enforcement
  • Safety profile enforcement

Acceptance Criteria

  • robot/e2e/m7_acceptance.robot file created
  • Test suite covers all M7 acceptance criteria from milestone description
  • All test cases pass with nox -e integration_tests
  • No mocking used in Robot Framework tests (real services only)
  • Coverage >= 97%

Dependencies

  • Blocked by: (none)
  • Blocks: #3374

Subtasks

  • Create robot/e2e/m7_acceptance.robot file
  • Write test cases for advanced context strategies
  • Write test cases for additional LLM provider configuration
  • Write test cases for additional resource types
  • Write test cases for A2A protocol compliance
  • Write test cases for cost/session budget enforcement
  • Write test cases for safety profile enforcement
  • Verify nox -e integration_tests passes

Definition of Done

  • All subtasks completed
  • Tests written and passing
  • All nox stages pass
  • Coverage >= 97%

Automated by CleverAgents Bot
Supervisor: Unknown | Agent: ca-epic-planner

## Metadata - **Branch**: `test/v3.6.0/m7-acceptance-tests` - **Commit Message**: `test(e2e): create M7 (v3.6.0) acceptance test suite` - **Milestone**: v3.6.0 - **Parent Epic**: #3374 ## Background Issue #3328 identified that `robot/e2e/m7_acceptance.robot` is missing. M1, M2, M5, and M6 all have acceptance tests but M7 (v3.6.0) does not. The M7 acceptance test should verify the key capabilities of the v3.6.0 milestone: advanced context strategies, additional LLM providers, additional resource types, A2A protocol compliance, container tool execution, cost/session budgets, and safety profiles. ## Expected Behavior `robot/e2e/m7_acceptance.robot` exists and contains test cases that verify: - Advanced context strategies are functional - Additional LLM providers (Cohere, Groq) can be configured - Additional resource types (cloud, database hierarchy) work - A2A protocol compliance (JSON-RPC 2.0 framing) - Cost/session budget enforcement - Safety profile enforcement ## Acceptance Criteria - [ ] `robot/e2e/m7_acceptance.robot` file created - [ ] Test suite covers all M7 acceptance criteria from milestone description - [ ] All test cases pass with `nox -e integration_tests` - [ ] No mocking used in Robot Framework tests (real services only) - [ ] Coverage >= 97% ## Dependencies - Blocked by: (none) - Blocks: #3374 ## Subtasks - [ ] Create `robot/e2e/m7_acceptance.robot` file - [ ] Write test cases for advanced context strategies - [ ] Write test cases for additional LLM provider configuration - [ ] Write test cases for additional resource types - [ ] Write test cases for A2A protocol compliance - [ ] Write test cases for cost/session budget enforcement - [ ] Write test cases for safety profile enforcement - [ ] Verify `nox -e integration_tests` passes ## Definition of Done - [ ] All subtasks completed - [ ] Tests written and passing - [ ] All nox stages pass - [ ] Coverage >= 97% --- **Automated by CleverAgents Bot** Supervisor: Unknown | Agent: ca-epic-planner
freemo added this to the v3.6.0 milestone 2026-04-05 14:43:08 +00:00
Author
Owner

Issue triaged by project owner:

  • State: Verified
  • Priority: High — M7 (v3.6.0) is the only milestone without an E2E acceptance test suite. M1, M2, M5, and M6 all have acceptance tests.
  • Milestone: v3.6.0 (already set)
  • Story Points: 5 — L — Requires creating a comprehensive Robot Framework acceptance test suite covering all v3.6.0 features. Estimated 1-2 days.
  • MoSCoW: Should Have — Acceptance tests validate milestone completion but individual features have their own unit/integration tests. Important for quality assurance but not strictly blocking release.
  • Parent Epic: #3374

Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: ca-project-owner

Issue triaged by project owner: - **State**: Verified - **Priority**: High — M7 (v3.6.0) is the only milestone without an E2E acceptance test suite. M1, M2, M5, and M6 all have acceptance tests. - **Milestone**: v3.6.0 (already set) - **Story Points**: 5 — L — Requires creating a comprehensive Robot Framework acceptance test suite covering all v3.6.0 features. Estimated 1-2 days. - **MoSCoW**: Should Have — Acceptance tests validate milestone completion but individual features have their own unit/integration tests. Important for quality assurance but not strictly blocking release. - **Parent Epic**: #3374 --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: ca-project-owner
freemo removed this from the v3.6.0 milestone 2026-04-06 23:52:38 +00:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Reference
cleveragents/cleveragents-core#3375
No description provided.