chore(tests): suppress passing scenario output by default in behave-parallel unit test runner #10988

Merged

hurui200320 merged 3 commits from feat/test-infra/suppress-passing-output into master 2026-05-07 13:00:47 +00:00

Conversation 24 Commits 3 Files Changed 12

+356 -36

3 Commits

Author	SHA1	Message	Date
hurui200320	bef7f3175b	fix(tests): resolve integration test failures in behave parallel log filtering ... Fix the integration test helper so that it can load scripts/run_behave_parallel.py outside of nox sessions. The helper imports the runner module via importlib, which triggers the top-level from behave_pass_suppress_formatter import PassSuppressFormatter. When invoked from integration tests (or any non-nox context), neither behave_pass_suppress_formatter nor the behave_parallel package (created by noxfile.py for unit_tests) is on sys.path, causing a ModuleNotFoundError and all 6 Robot tests to fail with exit code 1. The fix adds scripts/ to sys.path before loading the runner module so that from behave_pass_suppress_formatter import PassSuppressFormatter resolves correctly. This mirrors the approach already used in noxfile.py's unit_tests session for the behave-parallel package. Also addresses review feedback: - Removes one blank line from scripts/run_behave_parallel.py to bring it to 499 lines, satisfying the project's <500-line code style rule. - Moves in-function behave imports (Configuration, StreamOpener) in features/steps/behave_parallel_log_filtering_steps.py to the top-level import block alongside the existing behave imports, complying with the project's rule that all imports must be at the top of the file. Refs: #10987	2026-05-07 18:09:26 +08:00
hurui200320	4fe87d9eec	fix(tests): resolve pre-existing unit test failures in 5 feature files ... Fix five pre-existing BDD test failures that were present on master before PR #10988 was opened: 1. **architecture.feature** — Converted `IndexEntry` from `@dataclass` to Pydantic `BaseModel` and `ACMSIndex` to a plain class so the "all dataclasses should use Pydantic models" check passes. 2. **pr_compliance_checklist.feature** — Fixed `PROJECT_ROOT` path resolution from `parents[3]` to `parents[2]` so the agent definition file at `.opencode/agents/implementation-supervisor.md` is located correctly within the `/app` workspace. 3. **acms/index_data_model_and_traversal.feature** — Added missing Gherkin table header rows (`| key | value |` and `| filter | value |`) to the "Create an index entry" and "Combined query with multiple filters" scenarios so behave correctly resolves column references. 4. **cli_init_yes_flag.feature** — Added a `getattr` guard around `context.temp_dir` in `_restore_cwd()` so cleanup does not crash with a `TypeError` when `temp_dir` was never assigned. 5. **security_audit.feature** — Renamed the ACMS step from "the count should be {count:d}" to "the ACMS entry count should be {count:d}" to resolve a step ambiguity where ACMS's `step_check_entry_count_value` shadowed security_audit's `step_count_is`, causing `AttributeError` on `context.entry_count` for audit scenarios. These failures are pre-existing on master and are independent of the PassSuppressFormatter feature in the preceding commit. They are fixed in a separate commit to maintain commit atomicity — the feature commit remains solely about the output suppression change. Refs: #10987	2026-05-07 18:09:25 +08:00
hurui200320	49f1cfcdb6	chore(tests): suppress passing scenario output by default in behave-parallel unit test runner ... Implemented PassSuppressFormatter, a custom Behave formatter that buffers per-scenario output and only flushes it to stdout when the scenario failed or errored. Passing scenarios produce no output, keeping an all-passing suite at ~5-10 lines (the _print_overall_summary block only). Key design decisions: - PassSuppressFormatter (in scripts/behave_pass_suppress_formatter.py) inherits from behave's Formatter base class so it can be registered via behave.formatter._registry.register_as(), which enforces issubclass(cls, Formatter). - _SUPPRESS_STATUSES = {'passed', 'skipped'} determines which terminal statuses are silently discarded; all others (failed, undefined, etc.) trigger a buffer flush so no failure is hidden. - _make_runner() in run_behave_parallel.py registers the formatter and sets it as the default format whenever config.format is None (no explicit -f/--format flag). Coverage mode (BEHAVE_PARALLEL_COVERAGE=1) bypasses the formatter and falls back to config.default_format so slipcover can instrument a single process. - The formatter lives in a separate file to keep both scripts under the 500-line limit. _install_behave_parallel() in noxfile.py copies both files into the behave_parallel package. A try/except import handles both the direct-script path (tests via importlib) and the installed- package path (nox CI). - Three new BDD scenarios in behave_parallel_log_filtering.feature cover: (1) passing scenario -> no output, (2) failing scenario -> full output, (3) mixed run -> only failing scenario visible. All 20 scenarios pass. ISSUES CLOSED: #10987	2026-05-07 07:08:52 +00:00