UAT: agents diagnostics missing 3 spec-required health checks — Text index, Vector index, and Graph store checks not implemented #6846

Open
opened 2026-04-10 03:12:19 +00:00 by HAL9000 · 0 comments
Owner

What Was Tested

Code analysis of src/cleveragents/cli/commands/system.py build_diagnostics_data() function listing all implemented diagnostic checks, compared against the spec-defined output.

Expected Behavior (from spec)

The spec (docs/specification.md, lines 872-884) shows the diagnostics Rich output must include these 10 checks:

Config file      OK      readable
Database         OK      writable
OPENAI_API_KEY   WARN    missing
Anthropic key    OK      configured
Disk space       OK      2.1 GB free
Text index       OK      tantivy 0.22
Vector index     OK      faiss (CPU)
Graph store      WARN    not configured
File permissions OK      data dir r/w
Git              OK      git 2.43.0

The summary line reads Checks: 10 total.

Actual Behavior

build_diagnostics_data() only implements 7 check categories (some expand to multiple items):

checks.append(_check_config_file())
checks.append(_check_data_dir())
checks.append(_check_database())
checks.extend(_check_providers())   # expands to N per provider
checks.append(_check_disk_space())
checks.append(_check_file_permissions())
checks.append(_check_git())
checks.append(_check_stale_locks())
checks.append(_check_async_worker_health())
checks.append(_check_error_patterns())

Notably absent:

  • _check_text_index() — should report text search backend (e.g., tantivy 0.22)
  • _check_vector_index() — should report vector store (e.g., faiss (CPU))
  • _check_graph_store() — should report graph store connectivity (e.g., not configured)

Impact

The agents diagnostics command is a health-check tool that users rely on to verify system readiness. Missing checks for the index and graph store backends means configuration problems in these areas go undetected by diagnostics.

Steps to Reproduce

agents diagnostics

Observe that Text index, Vector index, and Graph store rows are absent from the Checks table.


Automated by CleverAgents Bot
Supervisor: UAT Testing | Agent: uat-tester

## What Was Tested Code analysis of `src/cleveragents/cli/commands/system.py` `build_diagnostics_data()` function listing all implemented diagnostic checks, compared against the spec-defined output. ## Expected Behavior (from spec) The spec (`docs/specification.md`, lines 872-884) shows the diagnostics Rich output must include these 10 checks: ``` Config file OK readable Database OK writable OPENAI_API_KEY WARN missing Anthropic key OK configured Disk space OK 2.1 GB free Text index OK tantivy 0.22 Vector index OK faiss (CPU) Graph store WARN not configured File permissions OK data dir r/w Git OK git 2.43.0 ``` The summary line reads `Checks: 10 total`. ## Actual Behavior `build_diagnostics_data()` only implements 7 check categories (some expand to multiple items): ```python checks.append(_check_config_file()) checks.append(_check_data_dir()) checks.append(_check_database()) checks.extend(_check_providers()) # expands to N per provider checks.append(_check_disk_space()) checks.append(_check_file_permissions()) checks.append(_check_git()) checks.append(_check_stale_locks()) checks.append(_check_async_worker_health()) checks.append(_check_error_patterns()) ``` Notably absent: - `_check_text_index()` — should report text search backend (e.g., `tantivy 0.22`) - `_check_vector_index()` — should report vector store (e.g., `faiss (CPU)`) - `_check_graph_store()` — should report graph store connectivity (e.g., `not configured`) ## Impact The `agents diagnostics` command is a health-check tool that users rely on to verify system readiness. Missing checks for the index and graph store backends means configuration problems in these areas go undetected by diagnostics. ## Steps to Reproduce ```bash agents diagnostics ``` Observe that `Text index`, `Vector index`, and `Graph store` rows are absent from the Checks table. --- **Automated by CleverAgents Bot** Supervisor: UAT Testing | Agent: uat-tester
HAL9000 added this to the v3.4.0 milestone 2026-04-10 03:12:19 +00:00
HAL9000 self-assigned this 2026-04-10 06:06:37 +00:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
cleveragents/cleveragents-core#6846
No description provided.