freemo
8ed13c4c14
Category 1 — Remove stale @tdd_expected_fail (tests pass in CI, bug fixed): - cli_lifecycle.robot: remove from 7 tests (bugs fixed, test helpers work) - cli_formats.robot: remove from 5 tests (format flag works in CI) - tui_smoke.robot: remove from TUI Headless tests (working in CI) - wf02_test_generation_integration.robot: remove from all 4 tests (working) Category 2 — Fix colon/single-space tag format → proper 4-space Robot syntax: - a2a_facade.robot: tdd_issue tdd_issue_4190 → tdd_issue tdd_issue_4190 - container_tool_exec.robot: fix tdd_issue:4188 format - coverage_threshold.robot: fix tdd_issue:4188 format - m6_autonomy_acceptance.robot: fix tdd_issue:4188 format - plan_diff_artifacts.robot: fix single-space format on all tests - project_context_policy.robot: fix single-space format - project_context_set_exec_env_priority.robot: add tdd_expected_fail to Force Tags Category 3 — Add missing @tdd_expected_fail to 32 genuinely failing tests: - cli_lifecycle_e2e.robot: Plan List namespace filter tests (#4301) - config_cli.robot: Config Set Get Roundtrip (#4302) - config_project_scope.robot: Project Scoped CLI roundtrip (#4303) - config_resolution.robot: Config Service Registers All Spec Keys (#4304) - coverage_threshold.robot: Noxfile threshold constant (#4305) - tdd_acms_behavioral_validation.robot: 4 context tests (#4306) - wf17_project_exec_env_priority.robot: context show test (#4307) - invariant_reconciliation_actor.robot: non-overridable invariant (#4308) - m4_e2e_verification.robot: CLI plan tree subplan (#4309) - m6_autonomy_acceptance.robot: M6 full autonomy flow (#4310) - plan_cli_spec.robot: Plan list rich output (#4311) - project_context_cli.robot: 3 context wired tests (#4313) - session_model.robot: CLI dict required keys (#4315) - tdd_budget_eviction_deletes_not_demotes.robot: 2 TDD tests (#4316) - tdd_e2e_implicit_init.robot: 2 implicit init tests (#4317) - tdd_invariant_persistence.robot: 3 invariant persistence tests (#4318) - tdd_plan_correct_auto_resolve.robot: 2 auto-resolve tests (#4319) - tdd_sqlite_url_cwd.robot: 2 SQLite URL tests (#4320) Issues created: #4301–#4320 tracking all remaining failures
49 lines
2.1 KiB
Plaintext
49 lines
2.1 KiB
Plaintext
*** Settings ***
|
|
Documentation Coverage threshold enforcement tests
|
|
... Validates that coverage configuration and nox session are
|
|
... properly set up to enforce the 97% coverage requirement.
|
|
Resource ${CURDIR}/common.resource
|
|
Suite Setup Setup Test Environment
|
|
Suite Teardown Cleanup Test Environment
|
|
|
|
*** Test Cases ***
|
|
Noxfile Contains Coverage Threshold Constant
|
|
[Documentation] Verify COVERAGE_THRESHOLD = 97 is defined in noxfile.py
|
|
[Tags] coverage config tdd_issue tdd_issue_4305 tdd_expected_fail
|
|
|
|
${content}= Get File ${WORKSPACE}/noxfile.py
|
|
Should Contain ${content} COVERAGE_THRESHOLD = 97
|
|
|
|
Pyproject Contains Coverage Run Section
|
|
[Documentation] Verify [tool.coverage.run] section exists in pyproject.toml
|
|
[Tags] coverage config
|
|
${content}= Get File ${WORKSPACE}/pyproject.toml
|
|
Should Contain ${content} [tool.coverage.run]
|
|
|
|
Pyproject Has Branch Coverage Enabled
|
|
[Documentation] Verify branch = true is in coverage.run config
|
|
[Tags] coverage config
|
|
${content}= Get File ${WORKSPACE}/pyproject.toml
|
|
Should Contain ${content} branch = true
|
|
|
|
Pyproject Coverage Source Includes Src
|
|
[Documentation] Verify src is in the coverage source list
|
|
[Tags] coverage config
|
|
${content}= Get File ${WORKSPACE}/pyproject.toml
|
|
Should Contain ${content} source = ["src"
|
|
|
|
Coverage Threshold Is 97 In Noxfile
|
|
[Documentation] Verify noxfile enforces 97% threshold via fail-under
|
|
[Tags] tdd_issue tdd_issue_4227 tdd_expected_fail
|
|
[Tags] coverage config
|
|
${content}= Get File ${WORKSPACE}/noxfile.py
|
|
Should Contain ${content} --fail-under=
|
|
|
|
Testing Guide Documentation Exists
|
|
[Documentation] Verify docs/development/testing.md was created
|
|
[Tags] coverage docs
|
|
${testing_doc}= Set Variable ${WORKSPACE}/docs/development/testing.md
|
|
File Should Exist ${testing_doc}
|
|
${content}= Get File ${testing_doc}
|
|
Should Contain ${content} 97%
|