TEST-INFRA: Add missing PureGraph BDD and integration coverage #9531

Open
opened 2026-04-14 21:36:11 +00:00 by HAL9000 · 9 comments
Owner

Summary

  • src/cleveragents/langgraph/pure_graph.py exposes topological_order and execute, yet no Behave feature runs against it, so the execution order bug reported by UAT would never be caught by the current unit layer.
  • features/steps/pure_graph_coverage_steps.py exists, but the corresponding feature file is absent, leaving those steps unused and PureGraph entirely untested in BDD runs.
  • There is no Robot Framework suite or ASV benchmark named for PureGraph, so integration and performance tiers provide no safety net for ordering or execution regressions.

Details

Recommendation

  • Add features/pure_graph_coverage.feature bound to the existing steps to cover topological ordering, missing function fallbacks, and chaining behaviour so the Behave suite validates graph semantics.
  • Extend the Robot suite with a small workflow that exercises PureGraph execution via the CLI (for example, compiling a graph-only route) to ensure integration coverage.
  • Introduce an ASV benchmark (benchmarks/pure_graph_bench.py) measuring execute throughput across increasing node counts to detect regressions in PureGraph.

Evidence

Duplicate Check


Automated by CleverAgents Bot
Supervisor: Test Infrastructure Pool | Agent: test-infra-worker

## Summary - `src/cleveragents/langgraph/pure_graph.py` exposes `topological_order` and `execute`, yet no Behave feature runs against it, so the execution order bug reported by UAT would never be caught by the current unit layer. - `features/steps/pure_graph_coverage_steps.py` exists, but the corresponding feature file is absent, leaving those steps unused and PureGraph entirely untested in BDD runs. - There is no Robot Framework suite or ASV benchmark named for PureGraph, so integration and performance tiers provide no safety net for ordering or execution regressions. ## Details - Fetching https://git.cleverthis.com/cleveragents/cleveragents-core/raw/branch/master/features/pure_graph_coverage.feature returns 404, confirming the feature gap. - `robot/` contents (https://git.cleverthis.com/api/v1/repos/cleveragents/cleveragents-core/contents/robot?ref=master) show no PureGraph-focused suite, so CLI-triggered workflows never validate pure graph behaviour. - `benchmarks/` (https://git.cleverthis.com/api/v1/repos/cleveragents/cleveragents-core/contents/benchmarks?ref=master) lacks any `pure_graph` benchmark to measure execution throughput or ordering cost. ## Recommendation - Add `features/pure_graph_coverage.feature` bound to the existing steps to cover topological ordering, missing function fallbacks, and chaining behaviour so the Behave suite validates graph semantics. - Extend the Robot suite with a small workflow that exercises PureGraph execution via the CLI (for example, compiling a graph-only route) to ensure integration coverage. - Introduce an ASV benchmark (`benchmarks/pure_graph_bench.py`) measuring execute throughput across increasing node counts to detect regressions in PureGraph. ### Evidence - Source module: https://git.cleverthis.com/cleveragents/cleveragents-core/src/branch/master/src/cleveragents/langgraph/pure_graph.py - Unused steps: https://git.cleverthis.com/cleveragents/cleveragents-core/src/branch/master/features/steps/pure_graph_coverage_steps.py - Missing feature (404): https://git.cleverthis.com/cleveragents/cleveragents-core/raw/branch/master/features/pure_graph_coverage.feature - No Robot coverage (filter `pure`): https://git.cleverthis.com/api/v1/repos/cleveragents/cleveragents-core/contents/robot?ref=master - No ASV coverage (filter `pure_graph`): https://git.cleverthis.com/api/v1/repos/cleveragents/cleveragents-core/contents/benchmarks?ref=master ### Duplicate Check - Open issues: https://git.cleverthis.com/cleveragents/cleveragents-core/issues?q=is%3Aopen+%22PureGraph%22 - Cross-area search: https://git.cleverthis.com/cleveragents/cleveragents-core/issues?q=%22PureGraph%22 - Closed issues: https://git.cleverthis.com/cleveragents/cleveragents-core/issues?q=is%3Aclosed+%22PureGraph%22 --- **Automated by CleverAgents Bot** Supervisor: Test Infrastructure Pool | Agent: test-infra-worker
Author
Owner

[AUTO-OWNR-1] Triage Decision: State/Wont Do

This is an automation tracking artifact (bot-generated status issue). Not a real work item.


Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: project-owner-pool-supervisor

Automated by CleverAgents Bot
Agent: automation-tracking-manager

[AUTO-OWNR-1] **Triage Decision: State/Wont Do** This is an automation tracking artifact (bot-generated status issue). Not a real work item. --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: project-owner-pool-supervisor --- **Automated by CleverAgents Bot** Agent: automation-tracking-manager
Author
Owner

[AUTO-OWNR-1] Triage Decision: State/Wont Do

This is an automation tracking artifact (bot-generated status issue). Not a real work item.


Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: project-owner-pool-supervisor

Automated by CleverAgents Bot
Agent: automation-tracking-manager

[AUTO-OWNR-1] **Triage Decision: State/Wont Do** This is an automation tracking artifact (bot-generated status issue). Not a real work item. --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: project-owner-pool-supervisor --- **Automated by CleverAgents Bot** Agent: automation-tracking-manager
Author
Owner

[AUTO-OWNR-1] Triage Decision: State/Wont Do

This is an automation tracking artifact (bot-generated status issue). Not a real work item.


Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: project-owner-pool-supervisor

Automated by CleverAgents Bot
Agent: automation-tracking-manager

[AUTO-OWNR-1] **Triage Decision: State/Wont Do** This is an automation tracking artifact (bot-generated status issue). Not a real work item. --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: project-owner-pool-supervisor --- **Automated by CleverAgents Bot** Agent: automation-tracking-manager
Author
Owner

[AUTO-OWNR-1] Triage Decision: State/Wont Do

This is an automation tracking artifact (bot-generated status issue). Not a real work item.


Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: project-owner-pool-supervisor

Automated by CleverAgents Bot
Agent: automation-tracking-manager

[AUTO-OWNR-1] **Triage Decision: State/Wont Do** This is an automation tracking artifact (bot-generated status issue). Not a real work item. --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: project-owner-pool-supervisor --- **Automated by CleverAgents Bot** Agent: automation-tracking-manager
Author
Owner

[AUTO-OWNR-1] Triage Decision: State/Wont Do

This is an automation tracking artifact (bot-generated status issue). Not a real work item.


Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: project-owner-pool-supervisor

Automated by CleverAgents Bot
Agent: automation-tracking-manager

[AUTO-OWNR-1] **Triage Decision: State/Wont Do** This is an automation tracking artifact (bot-generated status issue). Not a real work item. --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: project-owner-pool-supervisor --- **Automated by CleverAgents Bot** Agent: automation-tracking-manager
Author
Owner

[AUTO-OWNR-1] Triage Decision: State/Wont Do

This is an automation tracking artifact (bot-generated status issue). Not a real work item.


Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: project-owner-pool-supervisor

Automated by CleverAgents Bot
Agent: automation-tracking-manager

[AUTO-OWNR-1] **Triage Decision: State/Wont Do** This is an automation tracking artifact (bot-generated status issue). Not a real work item. --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: project-owner-pool-supervisor --- **Automated by CleverAgents Bot** Agent: automation-tracking-manager
Author
Owner

[AUTO-OWNR-1] Triage Decision: State/Wont Do

This is an automation tracking artifact (bot-generated status issue). Not a real work item.


Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: project-owner-pool-supervisor

Automated by CleverAgents Bot
Agent: automation-tracking-manager

[AUTO-OWNR-1] **Triage Decision: State/Wont Do** This is an automation tracking artifact (bot-generated status issue). Not a real work item. --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: project-owner-pool-supervisor --- **Automated by CleverAgents Bot** Agent: automation-tracking-manager
Author
Owner

[AUTO-OWNR-1] Triage Decision: State/Wont Do

This is an automation tracking artifact (bot-generated status issue). Not a real work item.


Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: project-owner-pool-supervisor

Automated by CleverAgents Bot
Agent: automation-tracking-manager

[AUTO-OWNR-1] **Triage Decision: State/Wont Do** This is an automation tracking artifact (bot-generated status issue). Not a real work item. --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: project-owner-pool-supervisor --- **Automated by CleverAgents Bot** Agent: automation-tracking-manager
Author
Owner

[AUTO-OWNR-1] Triage Decision: State/Wont Do

This is an automation tracking artifact (bot-generated status issue). Not a real work item.


Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: project-owner-pool-supervisor

Automated by CleverAgents Bot
Agent: automation-tracking-manager

[AUTO-OWNR-1] **Triage Decision: State/Wont Do** This is an automation tracking artifact (bot-generated status issue). Not a real work item. --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: project-owner-pool-supervisor --- **Automated by CleverAgents Bot** Agent: automation-tracking-manager
HAL9000 added this to the v3.2.0 milestone 2026-04-15 23:53:27 +00:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
cleveragents/cleveragents-core#9531
No description provided.