UAT: `agents diagnostics` missing "Text index", "Vector index", and "Graph store" health checks — spec requires all three #6151

New issue

Open

opened 2026-04-09 15:40:40 +00:00 by HAL9000 · 0 comments

HAL9000 commented

2026-04-09 15:40:40 +00:00

Owner

Bug Report

Feature Area: CLI Diagnostics (agents diagnostics)
Spec Reference: §CLI Commands — agents diagnostics (line 879–883)
Severity: Non-critical (backlog)

What Was Tested

Code-level analysis of src/cleveragents/cli/commands/system.py — specifically build_diagnostics_data() and the individual _check_* functions.

Expected Behavior (from spec)

The spec's diagnostics output example (§agents diagnostics, Rich tab) shows these checks:

│ Text index       OK      tantivy 0.22   │
│ Vector index     OK      faiss (CPU)    │
│ Graph store      WARN    not configured │

The spec also explicitly states (§Observability, line 46192):

Index health: Text index status, vector index dimensionality and count, graph store connectivity.

The JSON output example (line 949–951) also includes these three checks:

{ "check": "Text index", "status": "ok", "details": "tantivy 0.22" },
{ "check": "Vector index", "status": "ok", "details": "faiss (CPU)" },
{ "check": "Graph store", "status": "warn", "details": "not configured" },

Actual Behavior

build_diagnostics_data() in system.py runs these checks:

_check_config_file()
_check_data_dir()
_check_database()
_check_providers() (9 providers)
_check_disk_space()
_check_file_permissions()
_check_git()
_check_stale_locks()
_check_async_worker_health()
_check_error_patterns()

There are no _check_text_index(), _check_vector_index(), or _check_graph_store() functions. These three checks are entirely absent from the implementation.

The codebase does have the underlying services:

src/cleveragents/application/services/vector_store_service.py — FAISS vector backend
src/cleveragents/config/settings.py — index.text.backend (tantivy/sqlite_fts) and index.vector.backend (faiss/qdrant/none) config keys
src/cleveragents/application/services/config_service.py — exposes these config values

Steps to Reproduce

Run agents diagnostics
Observe output — no "Text index", "Vector index", or "Graph store" rows appear

Code Location

Missing implementation: src/cleveragents/cli/commands/system.py — build_diagnostics_data() (line 465–507)
Existing services to query: src/cleveragents/application/services/vector_store_service.py, src/cleveragents/config/settings.py

Impact

Users cannot determine the health of their search indexes from agents diagnostics. The "Index health" observability requirement from the spec is unimplemented. This is particularly impactful for users debugging why semantic search or context assembly is not working.

Automated by CleverAgents Bot
Supervisor: UAT Testing | Agent: uat-tester

## Bug Report **Feature Area**: CLI Diagnostics (`agents diagnostics`) **Spec Reference**: §CLI Commands — agents diagnostics (line 879–883) **Severity**: Non-critical (backlog) --- ## What Was Tested Code-level analysis of `src/cleveragents/cli/commands/system.py` — specifically `build_diagnostics_data()` and the individual `_check_*` functions. ## Expected Behavior (from spec) The spec's diagnostics output example (§agents diagnostics, Rich tab) shows these checks: ``` │ Text index OK tantivy 0.22 │ │ Vector index OK faiss (CPU) │ │ Graph store WARN not configured │ ``` The spec also explicitly states (§Observability, line 46192): > 2. **Index health**: Text index status, vector index dimensionality and count, graph store connectivity. The JSON output example (line 949–951) also includes these three checks: ```json { "check": "Text index", "status": "ok", "details": "tantivy 0.22" }, { "check": "Vector index", "status": "ok", "details": "faiss (CPU)" }, { "check": "Graph store", "status": "warn", "details": "not configured" }, ``` ## Actual Behavior `build_diagnostics_data()` in `system.py` runs these checks: 1. `_check_config_file()` 2. `_check_data_dir()` 3. `_check_database()` 4. `_check_providers()` (9 providers) 5. `_check_disk_space()` 6. `_check_file_permissions()` 7. `_check_git()` 8. `_check_stale_locks()` 9. `_check_async_worker_health()` 10. `_check_error_patterns()` **There are no `_check_text_index()`, `_check_vector_index()`, or `_check_graph_store()` functions.** These three checks are entirely absent from the implementation. The codebase does have the underlying services: - `src/cleveragents/application/services/vector_store_service.py` — FAISS vector backend - `src/cleveragents/config/settings.py` — `index.text.backend` (tantivy/sqlite_fts) and `index.vector.backend` (faiss/qdrant/none) config keys - `src/cleveragents/application/services/config_service.py` — exposes these config values ## Steps to Reproduce 1. Run `agents diagnostics` 2. Observe output — no "Text index", "Vector index", or "Graph store" rows appear ## Code Location - **Missing implementation**: `src/cleveragents/cli/commands/system.py` — `build_diagnostics_data()` (line 465–507) - **Existing services to query**: `src/cleveragents/application/services/vector_store_service.py`, `src/cleveragents/config/settings.py` ## Impact Users cannot determine the health of their search indexes from `agents diagnostics`. The "Index health" observability requirement from the spec is unimplemented. This is particularly impactful for users debugging why semantic search or context assembly is not working. --- **Automated by CleverAgents Bot** Supervisor: UAT Testing | Agent: uat-tester

HAL9000 referenced this issue

2026-04-09 17:25:53 +00:00

[AUTO-WATCHDOG] System Health Report (Cycle 32) #6184

HAL9000 added the

labels

2026-04-09 17:28:00 +00:00