cleveragents/cleveragents-core

Fork 3

perf(tests): consolidate 141 trivially small feature files to reduce subprocess overhead #485

New issue

Closed

opened 2026-03-01 03:11:56 +00:00 by freemo · 1 comment

freemo commented

2026-03-01 03:11:56 +00:00

Owner

Metadata

Commit Message: perf(tests): consolidate 141 trivially small feature files into 34 domain groups
Branch: perf/consolidate-small-features

Background and Context

Part of #478.

Of the 339 BDD feature files, 141 complete in under 0.1 seconds of actual test time — many finish in under 10ms. However, each still incurs full subprocess overhead: Python interpreter startup (~200-500ms), package imports, step definition loading, and environment hook execution. Collectively these 141 features contribute only 5.4 seconds of test logic but consume significant wall-clock time due to 141 independent subprocess invocations.

Current State

141 feature files each running as an independent subprocess via behave-parallel
Combined actual test time: 5.4s (unit tests) / 9.6s (coverage)
Estimated subprocess overhead: 141 × ~1-2s = 141-282s of pure startup/teardown waste
These files account for 0.2% of total test runtime but 42% of total subprocess count

Target

Consolidate these 141 files into 34 domain-grouped feature files (or ~25 if single-file groups are merged into adjacent domains), reducing subprocess count by ~107-116 invocations.

The consolidation preserves all scenarios and step definitions — only the .feature file boundaries change. Each consolidated file groups scenarios from the same domain/module that share step definitions and fixtures.

Consolidation Mapping

The 141 files are organized into 34 domain groups based on naming prefix and functional area:

#	Consolidated File	Source Files	Count
1	`consolidated_routing.feature`	message_router_new_coverage, reactive_registry_adapter_coverage, reactive_routing_port, route_bridge_coverage, route_bridge_uncovered_lines, route_coverage_comprehensive, routing_adapter_coverage, routing_langgraph_port, stream_router_additional_coverage, stream_router_agent_tool_coverage, stream_router_coverage, stream_router_misc_uncovered, stream_router_new_branches, stream_router_remaining_coverage, stream_router_uncovered_paths, stream_router_unsafe_and_llm_coverage	16
2	`consolidated_actor.feature`	actor_compiler, actor_compiler_coverage, actor_config_new_coverage, actor_hierarchy, actor_registry_coverage, actor_registry_full_coverage, actor_registry_persistence, actor_runtime, m2_actor_tool_smoke	9
3	`consolidated_langgraph.feature`	langgraph_bridge_coverage, langgraph_dynamic_router_coverage, langgraph_graph_coverage, langgraph_nodes_additional_coverage, langgraph_nodes_coverage, langgraph_nodes_uncovered_lines, langgraph_state_additional_coverage, langgraph_state_branch_coverage, pure_graph_coverage	9
4	`consolidated_ai_models_providers.feature`	aimodelscredentials_coverage, aimodelserrors_coverage, aimodelsproviders_coverage, anthropic_provider, google_provider, langsmith_config, openrouter_provider	7
5	`consolidated_plan_model_lifecycle.feature`	plan_hierarchy_and_failure_handler, plan_lifecycle_helpers_coverage, plan_lifecycle_service_persistence_coverage, plan_lifecycle_transitions_r2, plan_model, plan_model_coverage, plan_model_uncovered_lines	7
6	`consolidated_domain_models.feature`	domain_models, enums_coverage, invariant_models, namespaced_project_model, session_model, subplan_model	6
7	`consolidated_misc.feature`	acp_facade, agents_base_uncovered_lines, bridge_coverage, coverage_improvements, m6_autonomy_acceptance, scale_test	6
8	`consolidated_sandbox.feature`	copy_on_write_sandbox, cow_sandbox_coverage_boost, no_sandbox_coverage, sandbox_checkpoints, sandbox_copy_on_write_coverage, sandbox_factory_coverage	6
9	`consolidated_skill.feature`	skill_context, skill_discovery, skill_flatten, skill_inline_coverage, skill_protocol, skill_resolution	6
10	`consolidated_tool.feature`	tool_lifecycle_coverage_boost, tool_model, tool_registry_service_coverage, tool_registry_service_fallback_coverage, tool_registry_service_uncovered_branches, tool_runtime	6
11	`consolidated_automation_profile.feature`	automation_level_removed, automation_profile, automation_profile_crud_coverage, automation_profile_service, automation_profiles_guards	5
12	`consolidated_quality_review.feature`	adr_compliance_checker_coverage, definition_of_done, diff_review, quality_gates_checker_coverage, review_playbook	5
13	`consolidated_security.feature`	security_eval, security_exceptions, security_readonly, security_secrets, security_templates	5
14	`consolidated_action.feature`	action_cli_additional_coverage, action_model, action_model_branch_coverage, action_schema	4
15	`consolidated_config.feature`	config_parser_coverage, config_resolution, config_service_coverage, coverage_threshold_config	4
16	`consolidated_context.feature`	context_analysis_agent_coverage, context_manager_coverage, context_service_analysis, context_vector_search	4
17	`consolidated_correction.feature`	correction_flows, correction_model, correction_service_coverage_r2, correction_service_new_coverage	4
18	`consolidated_plan_misc.feature`	plan_apply_service_coverage, plan_cli_legacy_r2, plan_cli_spec_print_r2, plan_execute_runtime	4
19	`consolidated_resource.feature`	resource_handler_service_coverage, resource_handlers, resource_registry_model, resource_type_model	4
20	`consolidated_change_tracking.feature`	change_tracking, changeset_capture, streamedchange_coverage	3
21	`consolidated_main_modules.feature`	main_module, modules, scripts	3
22	`consolidated_validation.feature`	validation_apply, validation_edge_cases, validation_pipeline_stream_coverage	3
23	`consolidated_binding_resolution.feature`	binding_resolution, binding_resolution_coverage	2
24	`consolidated_cli_misc.feature`	cli_config_jinja_port, system_cli_uncovered_branches	2
25	`consolidated_decision.feature`	decision_model, decision_persistence_serialization	2

Single-file groups (9 files that should be merged into the nearest domain group during implementation):

Source File	Recommended Merge Target
`agent_langgraph_port.feature`	→ `consolidated_langgraph.feature`
`container_coverage_r2.feature`	→ `consolidated_misc.feature`
`lsp_registry.feature`	→ `consolidated_misc.feature`
`memory_service_coverage.feature`	→ `consolidated_misc.feature`
`migration_runner_coverage.feature`	→ `consolidated_misc.feature`
`orguserconfig_coverage.feature`	→ `consolidated_domain_models.feature`
`project_context_policy.feature`	→ `consolidated_context.feature`
`system_coverage_boost.feature`	→ `consolidated_misc.feature`
`yaml_engine_direct_coverage.feature`	→ `consolidated_misc.feature`

After merging single-file groups: 141 files → 25 consolidated files (saving 116 subprocess invocations).

Acceptance Criteria

All 141 trivially small feature files (<0.1s) are consolidated into ~25 domain-grouped files
The original 141 .feature files are removed from the repository
All scenarios from the original files are present in the consolidated files (no scenario loss)
All step definitions continue to resolve correctly in consolidated files
nox -e unit_tests passes with all scenarios green
nox -e coverage_report reports >= 97% coverage
Subprocess count for the <0.1s tier drops from 141 to ~25

Subtasks

Preparation Phase

Create a verification script that extracts all scenario names from the 141 source files (to verify none are lost after consolidation)
Run nox -e unit_tests to establish baseline pass count (currently 7,134 scenarios across 339 features)
Verify that no two source files within the same consolidation group have conflicting Feature: names or Background: sections that would collide

Consolidation Phase — Large Groups (6+ files)

Group 1: consolidated_routing.feature (16 files)
- Merge: message_router_new_coverage.feature, reactive_registry_adapter_coverage.feature, reactive_routing_port.feature, route_bridge_coverage.feature, route_bridge_uncovered_lines.feature, route_coverage_comprehensive.feature, routing_adapter_coverage.feature, routing_langgraph_port.feature, stream_router_additional_coverage.feature, stream_router_agent_tool_coverage.feature, stream_router_coverage.feature, stream_router_misc_uncovered.feature, stream_router_new_branches.feature, stream_router_remaining_coverage.feature, stream_router_uncovered_paths.feature, stream_router_unsafe_and_llm_coverage.feature
- Convert each source file's Feature: block into a clearly commented section within the consolidated file
- Merge any Background: sections, deduplicating shared steps
Group 2: consolidated_actor.feature (9 files)
- Merge: actor_compiler.feature, actor_compiler_coverage.feature, actor_config_new_coverage.feature, actor_hierarchy.feature, actor_registry_coverage.feature, actor_registry_full_coverage.feature, actor_registry_persistence.feature, actor_runtime.feature, m2_actor_tool_smoke.feature
Group 3: consolidated_langgraph.feature (10 files, including merge of agent_langgraph_port.feature)
- Merge: langgraph_bridge_coverage.feature, langgraph_dynamic_router_coverage.feature, langgraph_graph_coverage.feature, langgraph_nodes_additional_coverage.feature, langgraph_nodes_coverage.feature, langgraph_nodes_uncovered_lines.feature, langgraph_state_additional_coverage.feature, langgraph_state_branch_coverage.feature, pure_graph_coverage.feature, agent_langgraph_port.feature
Group 4: consolidated_ai_models_providers.feature (7 files)
- Merge: aimodelscredentials_coverage.feature, aimodelserrors_coverage.feature, aimodelsproviders_coverage.feature, anthropic_provider.feature, google_provider.feature, langsmith_config.feature, openrouter_provider.feature
Group 5: consolidated_plan_model_lifecycle.feature (7 files)
- Merge: plan_hierarchy_and_failure_handler.feature, plan_lifecycle_helpers_coverage.feature, plan_lifecycle_service_persistence_coverage.feature, plan_lifecycle_transitions_r2.feature, plan_model.feature, plan_model_coverage.feature, plan_model_uncovered_lines.feature
Group 6: consolidated_domain_models.feature (7 files, including merge of orguserconfig_coverage.feature)
- Merge: domain_models.feature, enums_coverage.feature, invariant_models.feature, namespaced_project_model.feature, session_model.feature, subplan_model.feature, orguserconfig_coverage.feature
Group 7: consolidated_misc.feature (11 files, including 5 single-file merges)
- Merge: acp_facade.feature, agents_base_uncovered_lines.feature, bridge_coverage.feature, coverage_improvements.feature, m6_autonomy_acceptance.feature, scale_test.feature, container_coverage_r2.feature, lsp_registry.feature, memory_service_coverage.feature, migration_runner_coverage.feature, system_coverage_boost.feature, yaml_engine_direct_coverage.feature
Group 8: consolidated_sandbox.feature (6 files)
- Merge: copy_on_write_sandbox.feature, cow_sandbox_coverage_boost.feature, no_sandbox_coverage.feature, sandbox_checkpoints.feature, sandbox_copy_on_write_coverage.feature, sandbox_factory_coverage.feature
Group 9: consolidated_skill.feature (6 files)
- Merge: skill_context.feature, skill_discovery.feature, skill_flatten.feature, skill_inline_coverage.feature, skill_protocol.feature, skill_resolution.feature
Group 10: consolidated_tool.feature (6 files)
- Merge: tool_lifecycle_coverage_boost.feature, tool_model.feature, tool_registry_service_coverage.feature, tool_registry_service_fallback_coverage.feature, tool_registry_service_uncovered_branches.feature, tool_runtime.feature

Consolidation Phase — Medium Groups (3-5 files)

Group 11: consolidated_automation_profile.feature (5 files)
- Merge: automation_level_removed.feature, automation_profile.feature, automation_profile_crud_coverage.feature, automation_profile_service.feature, automation_profiles_guards.feature
Group 12: consolidated_quality_review.feature (5 files)
- Merge: adr_compliance_checker_coverage.feature, definition_of_done.feature, diff_review.feature, quality_gates_checker_coverage.feature, review_playbook.feature
Group 13: consolidated_security.feature (5 files)
- Merge: security_eval.feature, security_exceptions.feature, security_readonly.feature, security_secrets.feature, security_templates.feature
Group 14: consolidated_context.feature (5 files, including merge of project_context_policy.feature)
- Merge: context_analysis_agent_coverage.feature, context_manager_coverage.feature, context_service_analysis.feature, context_vector_search.feature, project_context_policy.feature
Group 15: consolidated_action.feature (4 files)
- Merge: action_cli_additional_coverage.feature, action_model.feature, action_model_branch_coverage.feature, action_schema.feature
Group 16: consolidated_config.feature (4 files)
- Merge: config_parser_coverage.feature, config_resolution.feature, config_service_coverage.feature, coverage_threshold_config.feature
Group 17: consolidated_correction.feature (4 files)
- Merge: correction_flows.feature, correction_model.feature, correction_service_coverage_r2.feature, correction_service_new_coverage.feature
Group 18: consolidated_plan_misc.feature (4 files)
- Merge: plan_apply_service_coverage.feature, plan_cli_legacy_r2.feature, plan_cli_spec_print_r2.feature, plan_execute_runtime.feature
Group 19: consolidated_resource.feature (4 files)
- Merge: resource_handler_service_coverage.feature, resource_handlers.feature, resource_registry_model.feature, resource_type_model.feature
Group 20: consolidated_change_tracking.feature (3 files)
- Merge: change_tracking.feature, changeset_capture.feature, streamedchange_coverage.feature
Group 21: consolidated_main_modules.feature (3 files)
- Merge: main_module.feature, modules.feature, scripts.feature
Group 22: consolidated_validation.feature (3 files)
- Merge: validation_apply.feature, validation_edge_cases.feature, validation_pipeline_stream_coverage.feature

Consolidation Phase — Small Groups (2 files)

Group 23: consolidated_binding_resolution.feature (2 files)
- Merge: binding_resolution.feature, binding_resolution_coverage.feature
Group 24: consolidated_cli_misc.feature (2 files)
- Merge: cli_config_jinja_port.feature, system_cli_uncovered_branches.feature
Group 25: consolidated_decision.feature (2 files)
- Merge: decision_model.feature, decision_persistence_serialization.feature

Cleanup Phase

Delete all 141 original source .feature files that were consolidated
Update any references to the old file names in step definitions, environment.py, CI config, or documentation
Run the verification script to confirm zero scenario loss (same count of scenario names before and after)

Verification Phase

Run nox -e unit_tests and confirm all scenarios pass (expected: same 7,134 scenarios, now across ~223 features instead of 339)
Run nox -e coverage_report and confirm coverage >= 97%
Verify subprocess count reduced from 339 to ~223 (141 removed, 25 consolidated added)
Measure wall-clock improvement from reduced subprocess overhead

Definition of Done

This issue is complete when:

All subtasks above are completed and checked off.
A Git commit is created where the first line of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details about the implementation.
The commit is pushed to the remote on the branch matching the Branch in Metadata exactly.
The commit is submitted as a pull request to master, reviewed, and merged before this issue is marked done.

## Metadata - **Commit Message**: `perf(tests): consolidate 141 trivially small feature files into 34 domain groups` - **Branch**: `perf/consolidate-small-features` ## Background and Context Part of #478. Of the 339 BDD feature files, **141 complete in under 0.1 seconds** of actual test time — many finish in under 10ms. However, each still incurs full subprocess overhead: Python interpreter startup (~200-500ms), package imports, step definition loading, and environment hook execution. Collectively these 141 features contribute only **5.4 seconds** of test logic but consume significant wall-clock time due to 141 independent subprocess invocations. ### Current State - **141 feature files** each running as an independent subprocess via `behave-parallel` - Combined actual test time: **5.4s** (unit tests) / **9.6s** (coverage) - Estimated subprocess overhead: **141 × ~1-2s = 141-282s** of pure startup/teardown waste - These files account for **0.2%** of total test runtime but **42%** of total subprocess count ### Target Consolidate these 141 files into **34 domain-grouped feature files** (or ~25 if single-file groups are merged into adjacent domains), reducing subprocess count by ~107-116 invocations. The consolidation preserves all scenarios and step definitions — only the `.feature` file boundaries change. Each consolidated file groups scenarios from the same domain/module that share step definitions and fixtures. ### Consolidation Mapping The 141 files are organized into 34 domain groups based on naming prefix and functional area: | # | Consolidated File | Source Files | Count | |---|---|---|---| | 1 | `consolidated_routing.feature` | message_router_new_coverage, reactive_registry_adapter_coverage, reactive_routing_port, route_bridge_coverage, route_bridge_uncovered_lines, route_coverage_comprehensive, routing_adapter_coverage, routing_langgraph_port, stream_router_additional_coverage, stream_router_agent_tool_coverage, stream_router_coverage, stream_router_misc_uncovered, stream_router_new_branches, stream_router_remaining_coverage, stream_router_uncovered_paths, stream_router_unsafe_and_llm_coverage | 16 | | 2 | `consolidated_actor.feature` | actor_compiler, actor_compiler_coverage, actor_config_new_coverage, actor_hierarchy, actor_registry_coverage, actor_registry_full_coverage, actor_registry_persistence, actor_runtime, m2_actor_tool_smoke | 9 | | 3 | `consolidated_langgraph.feature` | langgraph_bridge_coverage, langgraph_dynamic_router_coverage, langgraph_graph_coverage, langgraph_nodes_additional_coverage, langgraph_nodes_coverage, langgraph_nodes_uncovered_lines, langgraph_state_additional_coverage, langgraph_state_branch_coverage, pure_graph_coverage | 9 | | 4 | `consolidated_ai_models_providers.feature` | aimodelscredentials_coverage, aimodelserrors_coverage, aimodelsproviders_coverage, anthropic_provider, google_provider, langsmith_config, openrouter_provider | 7 | | 5 | `consolidated_plan_model_lifecycle.feature` | plan_hierarchy_and_failure_handler, plan_lifecycle_helpers_coverage, plan_lifecycle_service_persistence_coverage, plan_lifecycle_transitions_r2, plan_model, plan_model_coverage, plan_model_uncovered_lines | 7 | | 6 | `consolidated_domain_models.feature` | domain_models, enums_coverage, invariant_models, namespaced_project_model, session_model, subplan_model | 6 | | 7 | `consolidated_misc.feature` | acp_facade, agents_base_uncovered_lines, bridge_coverage, coverage_improvements, m6_autonomy_acceptance, scale_test | 6 | | 8 | `consolidated_sandbox.feature` | copy_on_write_sandbox, cow_sandbox_coverage_boost, no_sandbox_coverage, sandbox_checkpoints, sandbox_copy_on_write_coverage, sandbox_factory_coverage | 6 | | 9 | `consolidated_skill.feature` | skill_context, skill_discovery, skill_flatten, skill_inline_coverage, skill_protocol, skill_resolution | 6 | | 10 | `consolidated_tool.feature` | tool_lifecycle_coverage_boost, tool_model, tool_registry_service_coverage, tool_registry_service_fallback_coverage, tool_registry_service_uncovered_branches, tool_runtime | 6 | | 11 | `consolidated_automation_profile.feature` | automation_level_removed, automation_profile, automation_profile_crud_coverage, automation_profile_service, automation_profiles_guards | 5 | | 12 | `consolidated_quality_review.feature` | adr_compliance_checker_coverage, definition_of_done, diff_review, quality_gates_checker_coverage, review_playbook | 5 | | 13 | `consolidated_security.feature` | security_eval, security_exceptions, security_readonly, security_secrets, security_templates | 5 | | 14 | `consolidated_action.feature` | action_cli_additional_coverage, action_model, action_model_branch_coverage, action_schema | 4 | | 15 | `consolidated_config.feature` | config_parser_coverage, config_resolution, config_service_coverage, coverage_threshold_config | 4 | | 16 | `consolidated_context.feature` | context_analysis_agent_coverage, context_manager_coverage, context_service_analysis, context_vector_search | 4 | | 17 | `consolidated_correction.feature` | correction_flows, correction_model, correction_service_coverage_r2, correction_service_new_coverage | 4 | | 18 | `consolidated_plan_misc.feature` | plan_apply_service_coverage, plan_cli_legacy_r2, plan_cli_spec_print_r2, plan_execute_runtime | 4 | | 19 | `consolidated_resource.feature` | resource_handler_service_coverage, resource_handlers, resource_registry_model, resource_type_model | 4 | | 20 | `consolidated_change_tracking.feature` | change_tracking, changeset_capture, streamedchange_coverage | 3 | | 21 | `consolidated_main_modules.feature` | main_module, modules, scripts | 3 | | 22 | `consolidated_validation.feature` | validation_apply, validation_edge_cases, validation_pipeline_stream_coverage | 3 | | 23 | `consolidated_binding_resolution.feature` | binding_resolution, binding_resolution_coverage | 2 | | 24 | `consolidated_cli_misc.feature` | cli_config_jinja_port, system_cli_uncovered_branches | 2 | | 25 | `consolidated_decision.feature` | decision_model, decision_persistence_serialization | 2 | **Single-file groups** (9 files that should be merged into the nearest domain group during implementation): | Source File | Recommended Merge Target | |---|---| | `agent_langgraph_port.feature` | → `consolidated_langgraph.feature` | | `container_coverage_r2.feature` | → `consolidated_misc.feature` | | `lsp_registry.feature` | → `consolidated_misc.feature` | | `memory_service_coverage.feature` | → `consolidated_misc.feature` | | `migration_runner_coverage.feature` | → `consolidated_misc.feature` | | `orguserconfig_coverage.feature` | → `consolidated_domain_models.feature` | | `project_context_policy.feature` | → `consolidated_context.feature` | | `system_coverage_boost.feature` | → `consolidated_misc.feature` | | `yaml_engine_direct_coverage.feature` | → `consolidated_misc.feature` | After merging single-file groups: **141 files → 25 consolidated files** (saving 116 subprocess invocations). ## Acceptance Criteria - [x] All 141 trivially small feature files (<0.1s) are consolidated into ~25 domain-grouped files - [x] The original 141 `.feature` files are removed from the repository - [x] All scenarios from the original files are present in the consolidated files (no scenario loss) - [x] All step definitions continue to resolve correctly in consolidated files - [x] `nox -e unit_tests` passes with all scenarios green - [x] `nox -e coverage_report` reports >= 97% coverage - [x] Subprocess count for the <0.1s tier drops from 141 to ~25 ## Subtasks ### Preparation Phase - [x] Create a verification script that extracts all scenario names from the 141 source files (to verify none are lost after consolidation) - [x] Run `nox -e unit_tests` to establish baseline pass count (currently 7,134 scenarios across 339 features) - [x] Verify that no two source files within the same consolidation group have conflicting `Feature:` names or `Background:` sections that would collide ### Consolidation Phase — Large Groups (6+ files) - [x] **Group 1: `consolidated_routing.feature`** (16 files) - Merge: `message_router_new_coverage.feature`, `reactive_registry_adapter_coverage.feature`, `reactive_routing_port.feature`, `route_bridge_coverage.feature`, `route_bridge_uncovered_lines.feature`, `route_coverage_comprehensive.feature`, `routing_adapter_coverage.feature`, `routing_langgraph_port.feature`, `stream_router_additional_coverage.feature`, `stream_router_agent_tool_coverage.feature`, `stream_router_coverage.feature`, `stream_router_misc_uncovered.feature`, `stream_router_new_branches.feature`, `stream_router_remaining_coverage.feature`, `stream_router_uncovered_paths.feature`, `stream_router_unsafe_and_llm_coverage.feature` - Convert each source file's `Feature:` block into a clearly commented section within the consolidated file - Merge any `Background:` sections, deduplicating shared steps - [x] **Group 2: `consolidated_actor.feature`** (9 files) - Merge: `actor_compiler.feature`, `actor_compiler_coverage.feature`, `actor_config_new_coverage.feature`, `actor_hierarchy.feature`, `actor_registry_coverage.feature`, `actor_registry_full_coverage.feature`, `actor_registry_persistence.feature`, `actor_runtime.feature`, `m2_actor_tool_smoke.feature` - [x] **Group 3: `consolidated_langgraph.feature`** (10 files, including merge of `agent_langgraph_port.feature`) - Merge: `langgraph_bridge_coverage.feature`, `langgraph_dynamic_router_coverage.feature`, `langgraph_graph_coverage.feature`, `langgraph_nodes_additional_coverage.feature`, `langgraph_nodes_coverage.feature`, `langgraph_nodes_uncovered_lines.feature`, `langgraph_state_additional_coverage.feature`, `langgraph_state_branch_coverage.feature`, `pure_graph_coverage.feature`, `agent_langgraph_port.feature` - [x] **Group 4: `consolidated_ai_models_providers.feature`** (7 files) - Merge: `aimodelscredentials_coverage.feature`, `aimodelserrors_coverage.feature`, `aimodelsproviders_coverage.feature`, `anthropic_provider.feature`, `google_provider.feature`, `langsmith_config.feature`, `openrouter_provider.feature` - [x] **Group 5: `consolidated_plan_model_lifecycle.feature`** (7 files) - Merge: `plan_hierarchy_and_failure_handler.feature`, `plan_lifecycle_helpers_coverage.feature`, `plan_lifecycle_service_persistence_coverage.feature`, `plan_lifecycle_transitions_r2.feature`, `plan_model.feature`, `plan_model_coverage.feature`, `plan_model_uncovered_lines.feature` - [x] **Group 6: `consolidated_domain_models.feature`** (7 files, including merge of `orguserconfig_coverage.feature`) - Merge: `domain_models.feature`, `enums_coverage.feature`, `invariant_models.feature`, `namespaced_project_model.feature`, `session_model.feature`, `subplan_model.feature`, `orguserconfig_coverage.feature` - [x] **Group 7: `consolidated_misc.feature`** (11 files, including 5 single-file merges) - Merge: `acp_facade.feature`, `agents_base_uncovered_lines.feature`, `bridge_coverage.feature`, `coverage_improvements.feature`, `m6_autonomy_acceptance.feature`, `scale_test.feature`, `container_coverage_r2.feature`, `lsp_registry.feature`, `memory_service_coverage.feature`, `migration_runner_coverage.feature`, `system_coverage_boost.feature`, `yaml_engine_direct_coverage.feature` - [x] **Group 8: `consolidated_sandbox.feature`** (6 files) - Merge: `copy_on_write_sandbox.feature`, `cow_sandbox_coverage_boost.feature`, `no_sandbox_coverage.feature`, `sandbox_checkpoints.feature`, `sandbox_copy_on_write_coverage.feature`, `sandbox_factory_coverage.feature` - [x] **Group 9: `consolidated_skill.feature`** (6 files) - Merge: `skill_context.feature`, `skill_discovery.feature`, `skill_flatten.feature`, `skill_inline_coverage.feature`, `skill_protocol.feature`, `skill_resolution.feature` - [x] **Group 10: `consolidated_tool.feature`** (6 files) - Merge: `tool_lifecycle_coverage_boost.feature`, `tool_model.feature`, `tool_registry_service_coverage.feature`, `tool_registry_service_fallback_coverage.feature`, `tool_registry_service_uncovered_branches.feature`, `tool_runtime.feature` ### Consolidation Phase — Medium Groups (3-5 files) - [x] **Group 11: `consolidated_automation_profile.feature`** (5 files) - Merge: `automation_level_removed.feature`, `automation_profile.feature`, `automation_profile_crud_coverage.feature`, `automation_profile_service.feature`, `automation_profiles_guards.feature` - [x] **Group 12: `consolidated_quality_review.feature`** (5 files) - Merge: `adr_compliance_checker_coverage.feature`, `definition_of_done.feature`, `diff_review.feature`, `quality_gates_checker_coverage.feature`, `review_playbook.feature` - [x] **Group 13: `consolidated_security.feature`** (5 files) - Merge: `security_eval.feature`, `security_exceptions.feature`, `security_readonly.feature`, `security_secrets.feature`, `security_templates.feature` - [x] **Group 14: `consolidated_context.feature`** (5 files, including merge of `project_context_policy.feature`) - Merge: `context_analysis_agent_coverage.feature`, `context_manager_coverage.feature`, `context_service_analysis.feature`, `context_vector_search.feature`, `project_context_policy.feature` - [x] **Group 15: `consolidated_action.feature`** (4 files) - Merge: `action_cli_additional_coverage.feature`, `action_model.feature`, `action_model_branch_coverage.feature`, `action_schema.feature` - [x] **Group 16: `consolidated_config.feature`** (4 files) - Merge: `config_parser_coverage.feature`, `config_resolution.feature`, `config_service_coverage.feature`, `coverage_threshold_config.feature` - [x] **Group 17: `consolidated_correction.feature`** (4 files) - Merge: `correction_flows.feature`, `correction_model.feature`, `correction_service_coverage_r2.feature`, `correction_service_new_coverage.feature` - [x] **Group 18: `consolidated_plan_misc.feature`** (4 files) - Merge: `plan_apply_service_coverage.feature`, `plan_cli_legacy_r2.feature`, `plan_cli_spec_print_r2.feature`, `plan_execute_runtime.feature` - [x] **Group 19: `consolidated_resource.feature`** (4 files) - Merge: `resource_handler_service_coverage.feature`, `resource_handlers.feature`, `resource_registry_model.feature`, `resource_type_model.feature` - [x] **Group 20: `consolidated_change_tracking.feature`** (3 files) - Merge: `change_tracking.feature`, `changeset_capture.feature`, `streamedchange_coverage.feature` - [x] **Group 21: `consolidated_main_modules.feature`** (3 files) - Merge: `main_module.feature`, `modules.feature`, `scripts.feature` - [x] **Group 22: `consolidated_validation.feature`** (3 files) - Merge: `validation_apply.feature`, `validation_edge_cases.feature`, `validation_pipeline_stream_coverage.feature` ### Consolidation Phase — Small Groups (2 files) - [x] **Group 23: `consolidated_binding_resolution.feature`** (2 files) - Merge: `binding_resolution.feature`, `binding_resolution_coverage.feature` - [x] **Group 24: `consolidated_cli_misc.feature`** (2 files) - Merge: `cli_config_jinja_port.feature`, `system_cli_uncovered_branches.feature` - [x] **Group 25: `consolidated_decision.feature`** (2 files) - Merge: `decision_model.feature`, `decision_persistence_serialization.feature` ### Cleanup Phase - [x] Delete all 141 original source `.feature` files that were consolidated - [x] Update any references to the old file names in step definitions, `environment.py`, CI config, or documentation - [x] Run the verification script to confirm zero scenario loss (same count of scenario names before and after) ### Verification Phase - [x] Run `nox -e unit_tests` and confirm all scenarios pass (expected: same 7,134 scenarios, now across ~223 features instead of 339) - [x] Run `nox -e coverage_report` and confirm coverage >= 97% - [x] Verify subprocess count reduced from 339 to ~223 (141 removed, 25 consolidated added) - [x] Measure wall-clock improvement from reduced subprocess overhead ## Definition of Done This issue is complete when: - All subtasks above are completed and checked off. - A Git commit is created where the **first line** of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details about the implementation. - The commit is pushed to the remote on the branch matching the **Branch** in Metadata exactly. - The commit is submitted as a **pull request** to `master`, reviewed, and **merged** before this issue is marked done.

freemo added the

Session	Status
lint	PASS
typecheck	PASS
unit_tests	PASS — 235 features, 7510 scenarios, 29296 steps
integration_tests	PASS (pre-existing failures only)
coverage_report	PASS — 98% coverage

Rows
Columns

perf(tests): consolidate 141 trivially small feature files to reduce subprocess overhead #485

Metadata

Background and Context

Current State

Target

Consolidation Mapping

Acceptance Criteria

Subtasks

Preparation Phase

Consolidation Phase — Large Groups (6+ files)

Consolidation Phase — Medium Groups (3-5 files)

Consolidation Phase — Small Groups (2 files)

Cleanup Phase

Verification Phase

Definition of Done

Implementation Notes

Commit: 6088730 on perf/consolidate-small-features

What was done

Consolidation approach

Quality gate results

Fixes applied

Design decisions

Verification

Commit: `6088730` on `perf/consolidate-small-features`