freemo 254fd07496 test(providers): add ASV performance benchmark suite for the providers module ...

Implemented 5 new ASV benchmark files under benchmarks/:

- providers_cost_table_bench.py — ProviderCostTable construction (default +
  custom entries), iteration throughput across all providers/models, fallback
  path for unknown providers
- providers_cost_tracker_bench.py — CostTracker construction with various
  budget configurations, accumulation throughput (10/50 calls, mixed
  providers), daily spend tracking, get_cost_entry delegation
- providers_fallback_selector_bench.py — FallbackSelector construction with
  custom order and cost tracker, selection when no providers configured
  (exhausts full list), selection with configured provider at various positions
- providers_registry_bench.py — ProviderRegistry.get_all_providers,
  get_provider_info (by enum and string), is_provider_configured,
  multi-provider initialization
- providers_llm_adapters_bench.py — LangChainChatProvider,
  AnthropicChatProvider, GoogleChatProvider, OpenAIChatProvider,
  OpenRouterChatProvider instantiation with various configurations

Key design decisions:
- Carefully audited existing cost_controls_bench.py and
  provider_selection_bench.py to avoid duplicating any already-covered
  benchmarks
- Used MagicMock for Settings objects to avoid requiring real API keys in
  benchmarks
- LLM adapter benchmarks use mock factories to measure pure instantiation
  cost without network calls
- All benchmark classes use setup() fixtures to isolate measurement from
  fixture construction
- 68 benchmark methods total across 5 files, all verified to execute without
  errors

ISSUES CLOSED: #2800

2026-04-05 03:55:26 +00:00

..

__init__.py

Significantly revamped the base project to use more robust static checking including benchmarks and integration test support

2025-10-31 16:18:53 -04:00

_session_bench_common.py

test(session): add TDD failing tests for session create DI error

2026-03-11 02:42:13 +00:00

a2a_facade_bench.py

refactor(a2a): rename ACP module and symbols to A2A standard

2026-03-12 14:38:57 +00:00

acms_backends_bench.py

feat(acms): add text, vector, and graph backend protocol implementations

2026-03-03 03:29:31 +00:00

acms_fusion_bench.py

feat(acms): add strategy coordinator and fusion engine

2026-03-10 15:09:03 +00:00

acms_pipeline_bench.py

feat(acms): add ACMS v1 context pipeline

2026-03-05 01:28:50 +00:00

acms_pipeline_orchestrator_bench.py

feat(acms): implement pipeline orchestrator and Phase 1 components

2026-03-05 15:13:19 +00:00

acms_pipeline_phase2_bench.py

feat(correcting-plans): implement Predictive Error Prevention (Layer 4) with Error Pattern Database

2026-03-08 21:53:21 -04:00

acms_pipeline_phase3_bench.py

feat(correcting-plans): implement Predictive Error Prevention (Layer 4) with Error Pattern Database

2026-03-08 21:53:21 -04:00

action_cli_bench.py

feat(cli): align action commands to spec

2026-02-14 12:16:39 -05:00

action_schema_bench.py

docs(action): add action YAML schema and examples

2026-02-13 19:01:55 +05:30

actor_cli_bench.py

fix(cli): derive actor name from config file instead of positional argument

2026-03-30 18:27:59 +00:00

actor_compiler_bench.py

feat(actor): compile hierarchical actor configs to LangGraph

2026-02-24 17:57:18 +00:00

actor_examples_load_bench.py

test(actor): add ASV benchmarks for actor examples loading

2026-02-18 10:49:26 +00:00

actor_hierarchy_bench.py

feat(actor): extend hierarchical actor YAML schema and loader

2026-02-25 10:30:42 +00:00

actor_list_empty_bench.py

feat(resource): add cloud infrastructure resources

2026-03-17 13:14:37 -04:00

actor_loading_bench.py

feat(actor): add actor registry and loader

2026-02-19 11:29:34 +00:00

actor_registry_bench.py

Fix: Fixed linting errors

2026-02-22 14:18:24 -05:00

actor_runtime_bench.py

Fix: Fixed linting errors

2026-02-22 14:18:24 -05:00

actor_schema_bench.py

perf(actor): add ASV benchmarks for actor schema

2026-02-17 13:54:27 +00:00

agent_skills_loader_bench.py

feat(skill): add agent skills loader

2026-02-26 09:10:35 +00:00

agent_skills_registry_bench.py

feat(concurrency): add plan and project locks

2026-02-25 10:48:05 -05:00

apply_pipeline_bench.py

feat(apply): add validation-gated apply pipeline

2026-02-25 10:01:57 +00:00

async_execution_bench.py

feat(correcting-plans): implement Predictive Error Prevention (Layer 4) with Error Pattern Database

2026-03-08 21:53:21 -04:00

automation_legacy_cleanup_bench.py

refactor(automation): remove automation_level legacy fields

2026-02-20 15:57:21 +00:00

automation_profile_bench.py

refactor(autonomy): rename automation profile task flags to spec names

2026-03-30 13:18:07 +01:00

automation_profile_cli_bench.py

refactor(autonomy): rename automation profile task flags to spec names

2026-03-30 13:18:07 +01:00

automation_profile_resolution_bench.py

refactor(automation): remove automation_level legacy fields

2026-02-20 15:57:21 +00:00

autonomy_guardrails_bench.py

feat(automation): add autonomy guardrails and audit trail

2026-02-28 22:06:57 +00:00

bench_audit_service.py

feat(observability): wire AuditService.record() into domain services via EventBus auto-dispatch

2026-03-12 23:32:48 +00:00

bench_audit_subscriber_retry.py

fix(di): get_container() permanently caches failed audit subscriber in Singleton provider

2026-04-02 16:51:29 +00:00

bench_budget_check.py

feat(guardrails): implement Per-Session and Per-Org Cost Budgets

2026-03-10 14:18:04 -04:00

bench_context_tier_runtime.py

fix(acms): implement context tier runtime promotion/demotion/eviction

2026-03-25 17:49:06 +00:00

bench_coverage_report.py

feat(context): add hot/warm/cold tiers and actor views

2026-03-03 17:01:57 +00:00

bench_detail_level_map.py

feat(resource): add cloud infrastructure resources

2026-03-17 13:14:37 -04:00

bench_event_bus.py

feat(observability): implement Event System Domain Event Taxonomy (full EventType enum + DomainEvent model)

2026-03-26 11:52:52 +00:00

bench_fix_revalidate.py

feat(validation): implement Fix-then-Revalidate orchestration loop for required validations

2026-03-24 22:01:48 +00:00

bench_metrics_collection.py

feat(resource): add cloud infrastructure resources

2026-03-17 13:14:37 -04:00

bench_plugin_loader.py

feat(resource): add cloud infrastructure resources

2026-03-17 13:14:37 -04:00

bench_sandbox_strategy.py

feat(resource): add cloud infrastructure resources

2026-03-17 13:14:37 -04:00

bench_subprocess_overhead.py

feat(context): add hot/warm/cold tiers and actor views

2026-03-03 17:01:57 +00:00

bench_uko_layer3.py

test(coverage): add Behave scenarios for 39 under-covered modules

2026-03-31 21:47:12 +00:00

bench_unit_tests.py

feat(context): add hot/warm/cold tiers and actor views

2026-03-03 17:01:57 +00:00

binding_resolution_bench.py

Fix: Fixed linting errors

2026-02-22 14:18:24 -05:00

change_tracking_bench.py

feat(change): add ChangeSet models and invocation tracker

2026-02-21 16:27:40 +00:00

changeset_capture_bench.py

Merge branch 'master' into develop-20260217

2026-02-18 03:27:00 +00:00

changeset_persistence_bench.py

feat(changeset): persist changesets and diff artifacts

2026-02-26 02:47:14 +00:00

checkpoint_rollback_bench.py

feat(tool): implement BuiltinAdapter class and MCP automatic resource slot creation (#964)

2026-03-21 05:30:01 +00:00

ci_yaml_parse_bench.py

feat(ci): add nox-based PR validation workflow

2026-02-12 22:01:51 +00:00

cleanup_bench.py

Fix: Fixed linting errors

2026-02-22 14:18:24 -05:00

cli_benchmark.py

Tests: Added benchmarks for PlanGenerationGraph

2025-12-11 13:55:55 -05:00

cli_core_bench.py

feat(cli): enhance version/info/diagnostics with --format and --check

2026-02-18 12:18:03 +00:00

cli_extension_tests_bench.py

refactor(cli): rename plan lifecycle-list and lifecycle-apply to match specification

2026-04-02 19:09:04 +00:00

cli_extensions_bench.py

refactor(cli): rename plan lifecycle-list and lifecycle-apply to match specification

2026-04-02 19:09:04 +00:00

cli_format_bench.py

refactor(automation): remove automation_level legacy fields

2026-02-20 15:57:21 +00:00

cli_init_yes_bench.py

test(cli): add failing tests for agents init --yes missing option

2026-03-06 20:28:37 +00:00

cli_robot_flow_bench.py

refactor(cli): rename plan lifecycle-list and lifecycle-apply to match specification

2026-04-02 19:09:04 +00:00

cloud_resource_bench.py

feat(resource): add cloud infrastructure resources

2026-03-17 13:14:37 -04:00

component_resolver_bench.py

feat(correcting-plans): implement Predictive Error Prevention (Layer 4) with Error Pattern Database

2026-03-08 21:53:21 -04:00

concurrency_lock_bench.py

feat(concurrency): add plan and project locks

2026-02-25 10:48:05 -05:00

config_cli_bench.py

feat(config): add config service with multi-level resolution

2026-03-01 04:38:30 +00:00

config_project_scope_bench.py

feat(config): add project-scoped config overrides

2026-03-02 15:05:20 +00:00

config_resolution_bench.py

feat(config): add config service with multi-level resolution

2026-03-01 04:38:30 +00:00

container_tool_exec_bench.py

feat(devcontainer): add container-aware tool execution and I/O forwarding

2026-03-12 10:31:37 +00:00

context_assembly_scaling_bench.py

feat(perf): large project scaling tests (#984)

2026-03-21 04:46:45 +00:00

context_fragment_models_bench.py

feat(acms): add ContextFragment and ScoredFragment data models

2026-03-05 14:11:23 +00:00

context_indexing_bench.py

feat(acms): projects with 10,000+ files index without timeout

2026-03-30 10:18:19 +00:00

context_strategies_bench.py

feat(acms): implement context strategies batch 1

2026-03-05 12:58:57 +00:00

context_strategy_bench.py

feat(acms): add context strategy registry

2026-03-05 22:00:15 +00:00

context_tiers_bench.py

feat(context): add hot/warm/cold tiers and actor views

2026-03-03 17:01:57 +00:00

cost_controls_bench.py

feat(provider): add cost controls and fallback

2026-02-25 12:08:01 -05:00

coverage_report_bench.py

feat(repo): add resource repositories

2026-02-16 21:35:54 +00:00

cross_plan_correction_bench.py

feat(correcting-plans): implement Predictive Error Prevention (Layer 4) with Error Pattern Database

2026-03-08 21:53:21 -04:00

crp_model_bench.py

feat(acms): add context request protocol models

2026-03-02 14:32:31 +00:00

db_migration_action_args_bench.py

feat(db): add spec-aligned action and plan tables with migrations, ORM models, and benchmarks

2026-02-13 13:05:20 -05:00

db_migration_actions_bench.py

feat(db): add spec-aligned action and plan tables with migrations, ORM models, and benchmarks

2026-02-13 13:05:20 -05:00

db_migration_plans_bench.py

refactor(automation): remove automation_level legacy fields

2026-02-20 15:57:21 +00:00

db_resource_bench.py

feat(resource): add cloud infrastructure resources

2026-03-17 13:14:37 -04:00

decision_correction_bench.py

feat(M4.2): Correction service with revert/append BFS + dry-run

2026-02-22 16:40:06 +00:00

decision_correction_model_bench.py

test(integration): workflow example 7 — CI/CD integration, automated PR review and fix (ci profile)

2026-03-26 21:42:37 +00:00

decision_di_bench.py

test(integration): workflow example 7 — CI/CD integration, automated PR review and fix (ci profile)

2026-03-26 21:42:37 +00:00

decision_model_bench.py

feat(decision): add decision domain and context snapshots

2026-02-23 22:19:19 +00:00

decision_persistence_bench.py

refactor(test): rename decision persistence files to avoid conflict with master

2026-02-26 16:13:44 +00:00

decision_persistence_serialization_bench.py

refactor(test): rename decision persistence files to avoid conflict with master

2026-02-26 16:13:44 +00:00

decision_recording_bench.py

feat(service): add decision recording and snapshot store

2026-03-03 12:18:27 +00:00

depth_breadth_projection_bench.py

feat(acms): implement depth/breadth projection system

2026-03-05 15:42:20 +00:00

devcontainer_handler_bench.py

feat(correcting-plans): implement Predictive Error Prevention (Layer 4) with Error Pattern Database

2026-03-08 21:53:21 -04:00

devcontainer_lifecycle_bench.py

feat(resource): add cloud infrastructure resources

2026-03-17 13:14:37 -04:00

diff_review_bench.py

feat(change): add diff review artifacts

2026-02-25 10:02:38 +00:00

docs_build_bench.py

style: fix formatting

2026-02-20 20:38:53 +00:00

dod_evaluation_bench.py

feat(dod): enforce definition-of-done gating

2026-02-25 10:04:31 +00:00

error_recovery_bench.py

feat(concurrency): add plan and project locks

2026-02-25 10:48:05 -05:00

event_bus_bench.py

feat(events): add EventBus protocol and ReactiveEventBus implementation

2026-03-02 11:54:53 +00:00

execution_environment_bench.py

feat(correcting-plans): implement Predictive Error Prevention (Layer 4) with Error Pattern Database

2026-03-08 21:53:21 -04:00

execution_throughput_bench.py

feat(perf): large project scaling tests (#984)

2026-03-21 04:46:45 +00:00

faiss_vector_backend_bench.py

feat(acms): integrate FAISS into ACMS vector backend protocol

2026-03-30 13:19:08 +00:00

file_tool_bench.py

feat(skill): add file operation skills

2026-02-21 10:18:26 -05:00

git_tool_bench.py

test(robot): fix failing integration tests related to safe.directory config and git version

2026-02-21 18:11:31 +00:00

influence_dag_bench.py

feat(decision): implement influence DAG traversal in correction affected subtree computation

2026-03-04 15:36:34 +00:00

inline_tool_bench.py

feat(skill): add inline tool executor

2026-02-20 08:50:08 -05:00

invariant_merge_bench.py

Fix: Fixed linting errors

2026-02-22 14:18:24 -05:00

invariant_reconciliation_bench.py

feat(correcting-plans): implement Predictive Error Prevention (Layer 4) with Error Pattern Database

2026-03-08 21:53:21 -04:00

k8s_helm_chart_bench.py

feat(server): add Kubernetes Helm chart for server deployment (#1085)

2026-03-27 23:53:22 +00:00

large_project_decompose_bench.py

feat(plan): add large-project decomposition and dependency closure

2026-03-03 21:44:20 +00:00

large_project_scaling_bench.py

feat(perf): large project scaling tests (#984)

2026-03-21 04:46:45 +00:00

legacy_removal_bench.py

refactor(automation): remove automation_level legacy fields

2026-02-20 15:57:21 +00:00

llm_trace_bench.py

feat(correcting-plans): implement Predictive Error Prevention (Layer 4) with Error Pattern Database

2026-03-08 21:53:21 -04:00

lsp_registry_bench.py

feat(lsp): add registry and runtime stubs

2026-02-22 10:15:25 +00:00

lsp_stub_bench.py

feat(lsp): add LSP server stub

2026-03-06 18:16:47 +00:00

m1_sourcecode_smoke_bench.py

refactor(cli): rename plan lifecycle-list and lifecycle-apply to match specification

2026-04-02 19:09:04 +00:00

m2_actor_tool_smoke_bench.py

test(coverage): add Behave scenarios for remaining under-tested modules

2026-02-25 19:38:43 -05:00

m3_smoke_bench.py

test(e2e): add M3 decision + validation suites

2026-02-25 21:26:19 +00:00

m4_smoke_bench.py

fix(test): correct mock targets, method names, ULIDs, and CLI args in M4 smoke suite

2026-02-26 02:01:47 +00:00

m5_smoke_bench.py

test(e2e): add M5 ACMS + context suites

2026-02-27 20:20:13 +00:00

m6_acceptance_bench.py

refactor(a2a): rename ACP module and symbols to A2A standard

2026-03-12 14:38:57 +00:00

mcp_runtime_bench.py

feat(skill): add MCP adapter for external tools

2026-02-25 13:17:26 +00:00

multi_project_bench.py

feat(plan): add multi-project subplan support

2026-03-03 14:55:58 -05:00

output_rendering_bench.py

feat(cli): implement full output rendering framework (#812)

2026-03-19 08:46:46 +00:00

permission_check_bench.py

feat(correcting-plans): implement Predictive Error Prevention (Layer 4) with Error Pattern Database

2026-03-08 21:53:21 -04:00

persistence_robot_bench.py

fix(ci): remove stale AutomationLevel refs from benchmarks and prevent ANSI in JSON output

2026-02-20 21:46:46 +00:00

persistence_suites_bench.py

refactor(automation): remove automation_level legacy fields

2026-02-20 15:57:21 +00:00

phase_reversion_bench.py

test(coverage): add Behave scenarios for 39 under-covered modules

2026-03-31 21:47:12 +00:00

plan_actor_integration_bench.py

feat(plan): execute strategize and execute via actors

2026-02-21 10:18:26 -05:00

plan_cli_bench.py

refactor(cli): rename plan lifecycle-list and lifecycle-apply to match specification

2026-04-02 19:09:04 +00:00

plan_cli_smoke_bench.py

refactor(cli): rename plan lifecycle-list and lifecycle-apply to match specification

2026-04-02 19:09:04 +00:00

plan_correct_tree_wiring_bench.py

feat(correcting-plans): implement Predictive Error Prevention (Layer 4) with Error Pattern Database

2026-03-08 21:53:21 -04:00

plan_diff_bench.py

Tests: Significantly improved coverage of the unit tests

2026-02-22 00:43:08 -05:00

plan_execute_bench.py

feat(M1.2): PlanExecutionContext, RuntimeExecuteActor, and runtime mode

2026-02-22 15:13:43 +00:00

plan_explain_bench.py

feat(perf): large project scaling tests (#984)

2026-03-21 04:46:45 +00:00

plan_generation_benchmark.py

fix(provider): remove FakeListLLM defaults

2026-02-27 09:47:10 -05:00

plan_lifecycle_persistence_bench.py

fix(tests): resolve unit test and benchmark failures

2026-02-17 02:24:35 +00:00

plan_model_bench.py

fix(tests): resolve unit test and benchmark failures

2026-02-17 02:24:35 +00:00

plan_phase_bench.py

Fix: Fixed linting errors

2026-02-22 14:18:24 -05:00

plan_phase_migration_bench.py

fix(db): align v3_plans schema with specification DDL

2026-03-30 23:40:36 +01:00

plan_preflight_guardrails_bench.py

feat(guardrails): implement Plan Generation Pre-flight Guardrails (7 checks before execution)

2026-03-08 22:31:40 +00:00

plan_repository_bench.py

refactor(automation): remove automation_level legacy fields

2026-02-20 15:57:21 +00:00

plan_resume_bench.py

feat(concurrency): add plan resume

2026-02-25 14:00:04 -05:00

predictive_error_prevention_bench.py

feat(correcting-plans): implement Predictive Error Prevention (Layer 4) with Error Pattern Database

2026-03-08 21:53:21 -04:00

project_cli_bench.py

feat(cli): add project commands (core)

2026-02-16 23:56:55 -05:00

project_context_cli_bench.py

Merge branch 'master' into develop-20260217

2026-02-18 03:27:00 +00:00

project_context_policy_bench.py

Merge branch 'master' into develop-20260217

2026-02-18 03:27:00 +00:00

project_create_persist_bench.py

fix(project): persist project to database during creation (#591)

2026-03-09 06:59:15 +00:00

project_migration_bench.py

Merge branch 'master' into feature/q0-min-coverage

2026-02-17 02:35:20 +00:00

project_repository_bench.py

Tests: Significantly improved coverage of the unit tests

2026-02-22 00:43:08 -05:00

project_show_after_create_bench.py

fix(project): show created project after creation (#593)

2026-03-09 07:56:38 +00:00

prompt_injection_mitigation_bench.py

feat(security): implement Prompt Injection Mitigation (5 mechanisms)

2026-03-08 22:19:40 +00:00

provider_selection_bench.py

fix(provider): remove FakeListLLM defaults

2026-02-27 09:47:10 -05:00

providers_cost_table_bench.py

test(providers): add ASV performance benchmark suite for the providers module

2026-04-05 03:55:26 +00:00

providers_cost_tracker_bench.py

test(providers): add ASV performance benchmark suite for the providers module

2026-04-05 03:55:26 +00:00

providers_fallback_selector_bench.py

test(providers): add ASV performance benchmark suite for the providers module

2026-04-05 03:55:26 +00:00

providers_llm_adapters_bench.py

test(providers): add ASV performance benchmark suite for the providers module

2026-04-05 03:55:26 +00:00

providers_registry_bench.py

test(providers): add ASV performance benchmark suite for the providers module

2026-04-05 03:55:26 +00:00

repl_bench.py

feat(cli): add interactive repl

2026-02-23 03:11:12 +00:00

resource_cli_bench.py

feat(cli): add resource commands (core)

2026-02-16 16:46:54 -05:00

resource_cli_tree_bench.py

test(integration): workflow example 7 — CI/CD integration, automated PR review and fix (ci profile)

2026-03-26 21:42:37 +00:00

resource_dag_bench.py

Fix: Fixed linting errors

2026-02-22 14:18:24 -05:00

resource_handler_bench.py

feat(resource): add handler runtime for git-checkout and fs-directory

2026-02-23 22:20:44 +00:00

resource_registry_bench.py

refactor(benchmark): clean up resource registry bench per review

2026-02-23 22:20:44 +00:00

resource_registry_migration_bench.py

Merge branch 'master' into feature/q0-min-coverage

2026-02-17 02:35:20 +00:00

resource_repository_bench.py

feat(session): add session persistence and repositories

2026-02-18 00:10:15 +00:00

resource_service_bench.py

feat(cli): add resource commands (core)

2026-02-16 16:46:54 -05:00

resource_type_builtin_bench.py

feat(resource): add git-checkout and fs-directory resource types

2026-02-15 10:44:14 -05:00

resource_type_deferred_physical_bench.py

feat(resource): add deferred physical resource types

2026-03-19 14:03:17 +00:00

resource_type_deferred_virtual_bench.py

feat(resource): add deferred virtual resource types

2026-03-18 02:30:00 +00:00

resource_type_fs_bench.py

Merge branch 'master' into develop-20260217

2026-02-18 03:27:00 +00:00

resource_type_inheritance_bench.py

feat(resource): add resource type inheritance and polymorphic tool matching

2026-03-10 03:39:32 +00:00

resource_type_model_bench.py

feat(resource): add resource type model + schema loader

2026-02-15 15:19:09 +00:00

resource_type_schema_bench.py

feat(resource): add resource type model + schema loader

2026-02-15 15:19:09 +00:00

resource_type_virtual_core_bench.py

feat(resource): add virtual core resource types

2026-03-18 01:45:25 +00:00

retry_policy_bench.py

feat(async): wire retry policies into services

2026-03-11 17:42:13 +00:00

safety_profile_bench.py

feat(security): add safety profile enforcement

2026-03-03 22:21:14 +00:00

safety_profile_model_bench.py

feat(security): add safety profile model and enforcement stubs

2026-03-02 17:44:18 +00:00

sandbox_boundary_bench.py

feat(sandbox): implement sandbox boundary algebra and domain computation

2026-03-04 15:59:15 +00:00

sandbox_checkpoint_bench.py

feat(sandbox): add checkpoint and rollback hooks

2026-02-27 23:08:55 +00:00

scale_fixture_bench.py

test(perf): add scale test fixtures

2026-02-20 03:31:43 +00:00

scoped_view_bench.py

feat(acms): add scoped backend view filtering

2026-03-06 00:49:33 +00:00

search_tool_bench.py

feat(skill): add directory and search skills

2026-02-21 10:18:26 -05:00

security_async_cleanup_bench.py

feat(perf): large project scaling tests (#984)

2026-03-21 04:46:45 +00:00

security_audit_bench.py

Tests: Significantly improved coverage of the unit tests

2026-02-22 00:43:08 -05:00

security_eval_bench.py

fix(security): remove eval-based config parsing

2026-02-21 16:32:03 +00:00

security_exception_bench.py

fix(security): enforce explicit exception handling

2026-02-25 10:05:57 +00:00

security_readonly_bench.py

feat(security): enforce read-only actions

2026-02-26 20:33:20 +00:00

security_scan_bench.py

feat(qa): align security scans with nox

2026-02-13 19:24:24 +00:00

security_secrets_bench.py

feat(security): add secrets masking and validation (H-21/SEC5)

2026-02-19 11:15:18 +00:00

security_template_bench.py

fix(security): harden template rendering

2026-02-25 10:06:27 +00:00

semantic_escalation_bench.py

refactor(autonomy): rename automation profile task flags to spec names

2026-03-30 13:18:07 +01:00

semantic_validation_bench.py

feat(correcting-plans): implement Predictive Error Prevention (Layer 4) with Error Pattern Database

2026-03-08 21:53:21 -04:00

semantic_validation_suite_bench.py

test(validation): add semantic validation suites

2026-03-02 22:05:53 +00:00

server_stub_bench.py

refactor(a2a): rename ACP module and symbols to A2A standard

2026-03-12 14:38:57 +00:00

session_cli_bench.py

feat(cli): add session commands

2026-02-20 01:10:19 +00:00

session_create_error_bench.py

test(cli): add failing tests for session create DI container error

2026-03-10 21:39:31 +00:00

session_list_bench.py

test(integration): workflow example 7 — CI/CD integration, automated PR review and fix (ci profile)

2026-03-26 21:42:37 +00:00

session_model_bench.py

feat(session): add session domain models and contracts

2026-02-14 03:50:40 +00:00

session_persistence_bench.py

Fix: Fixed linting errors

2026-02-22 14:18:24 -05:00

skeleton_compressor_bench.py

refactor(acms): unify ContextFragment model hierarchies by extending CRP base types

2026-03-05 21:38:55 +00:00

skill_add_persist_bench.py

fix(skill): persist skill registration to database after add

2026-03-08 02:57:44 +00:00

skill_cli_bench.py

test(coverage): add Behave BDD tests to improve coverage across 52 source files

2026-03-20 21:22:10 +00:00

skill_context_bench.py

Fix: Fixed linting errors

2026-02-22 14:18:24 -05:00

skill_flatten_bench.py

feat(actor): compile hierarchical actor configs to LangGraph

2026-02-24 17:57:18 +00:00

skill_protocol_bench.py

feat(skill): add skill protocol and metadata

2026-02-20 08:50:08 -05:00

skill_refresh_bench.py

feat(skill): add MCP refresh hooks

2026-02-26 12:29:49 +00:00

skill_registry_bench.py

feat(skill): add skill registry persistence

2026-02-21 16:30:40 +00:00

skill_registry_persist_bench.py

feat(skill): persist flattened tool sets

2026-02-27 20:09:26 +00:00

skill_resolution_bench.py

feat(skill): add skill domain model and resolver

2026-02-14 03:54:14 +00:00

skill_schema_bench.py

style(skill): apply ruff auto-formatting to skill schema files

2026-02-17 10:13:19 +00:00

subplan_actor_tool_bench.py

feat(actor): add plan_subplan tool and decision emission

2026-02-27 08:02:48 +00:00

subplan_execution_bench.py

feat(autonomy): parallel execution scales to 10+ concurrent subplans (#1201)

2026-03-31 23:57:39 +00:00

subplan_model_validation_bench.py

test(domain): add subplan model suites

2026-02-19 22:07:56 +00:00

subplan_spawn_bench.py

feat(service): add subplan service and spawn workflow

2026-03-02 09:41:25 -05:00

tdd_actor_list_validation_bench.py

refactor(testing): rename tdd_bug/tdd_bug_N tags to tdd_issue/tdd_issue_N

2026-03-27 05:58:35 +00:00

tdd_plan_correct_auto_resolve_bench.py

test: add TDD bug-capture test for #1025 — plan correct auto-resolve (#1172)

2026-04-01 00:40:46 +00:00

tdd_session_create_di_bench.py

refactor(testing): rename tdd_bug/tdd_bug_N tags to tdd_issue/tdd_issue_N

2026-03-27 05:58:35 +00:00

tdd_session_list_di_bench.py

refactor(testing): rename tdd_bug/tdd_bug_N tags to tdd_issue/tdd_issue_N

2026-03-27 05:58:35 +00:00

temporal_data_model_bench.py

feat(acms): implement Temporal Data Model (Revision-Aware RDF) with 3 storage tiers

2026-03-11 01:36:06 +00:00

tool_add_persist_bench.py

fix(tool): persist tool registration to database after add

2026-03-08 22:11:49 +00:00

tool_builtin_file_bench.py

feat(repo): add resource repositories

2026-02-16 21:35:54 +00:00

tool_cli_bench.py

feat(cli): add tool and validation commands

2026-02-20 08:49:30 -05:00

tool_lifecycle_bench.py

feat(tool): add tool lifecycle runtime

2026-02-14 18:55:48 +00:00

tool_model_bench.py

Fix: Fixed linting errors

2026-02-22 14:18:24 -05:00

tool_registry_bench.py

feat(tool): add tool registry persistence

2026-02-17 20:28:20 +00:00

tool_router_bench.py

feat(change): add tool router for providers

2026-02-21 10:23:31 -05:00

tool_runtime_bench.py

Fix: Fixed linting errors

2026-02-22 14:18:24 -05:00

tool_wrapping_bench.py

feat(validation): implement tool wrapping runtime (wraps + transform delegation)

2026-03-04 18:21:19 +00:00

uko_analyzers_bench.py

feat(uko): add analyzer plugin framework and initial domain analyzers

2026-03-05 19:20:39 +00:00

uko_indexer_bench.py

feat(acms): implement Real-time Index Sync / UKOIndexer with pluggable analyzers

2026-03-11 00:40:07 +00:00

uko_load_bench.py

feat(uko): add UKO ontology scaffolding

2026-03-04 22:40:34 +00:00

unified_context_models_bench.py

test(integration): workflow example 7 — CI/CD integration, automated PR review and fix (ci profile)

2026-03-26 21:42:37 +00:00

uow_lifecycle_bench.py

refactor(automation): remove automation_level legacy fields

2026-02-20 15:57:21 +00:00

validation_apply_bench.py

feat(apply): run validation attachments

2026-02-25 10:03:21 +00:00

validation_edge_bench.py

test(validation): add edge case suites

2026-02-20 02:54:08 +00:00

validation_pipeline_bench.py

feat(concurrency): add plan and project locks

2026-02-25 10:48:05 -05:00