drew
8119043837
CI / integration_tests (pull_request) Has started running
CI / push-validation (pull_request) Successful in 37s
CI / helm (pull_request) Successful in 40s
CI / build (pull_request) Successful in 46s
CI / lint (pull_request) Successful in 1m6s
CI / typecheck (pull_request) Successful in 1m6s
CI / quality (pull_request) Successful in 1m6s
CI / security (pull_request) Successful in 1m51s
CI / unit_tests (pull_request) Successful in 7m23s
CI / coverage (pull_request) Has started running
CI / docker (pull_request) Successful in 1m52s
CI / status-check (pull_request) Has been cancelled
integration_tests (Robot/pabot) failed on robot/coverage_threshold.robot
"Noxfile Contains Coverage Threshold Constant": it asserted the literal
`COVERAGE_THRESHOLD = 96.5` in noxfile.py, but the coverage_report session now
delegates the constant to pyproject's single source
(`COVERAGE_THRESHOLD = _read_coverage_fail_under()`).
This was the last WS5 reconciliation gap (the plan enumerated behave feature
steps + ci.yml + guidelines prose, but not the Robot suite). Assert the
delegation plus the pyproject floor (`fail_under = 96.5`) instead of the literal,
mirroring the behave step fix in b499834c0. The other assertions in the suite
(--fail-under= substring, [tool.coverage.run], branch=true, source=["src"]) are
unaffected; verified no other robot/behave/pytest test depends on the literal.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
54 lines
2.5 KiB
Plaintext
54 lines
2.5 KiB
Plaintext
*** Settings ***
|
|
Documentation Coverage threshold enforcement tests
|
|
... Validates that coverage configuration and nox session are
|
|
... properly set up to enforce the 96.5% coverage requirement.
|
|
Resource ${CURDIR}/common.resource
|
|
Suite Setup Setup Test Environment
|
|
Suite Teardown Cleanup Test Environment
|
|
|
|
*** Test Cases ***
|
|
Noxfile Contains Coverage Threshold Constant
|
|
[Documentation] Verify COVERAGE_THRESHOLD resolves the floor (96.5) from
|
|
... pyproject's single source [tool.coverage.report].fail_under
|
|
[Tags] coverage config tdd_issue tdd_issue_4305
|
|
|
|
# WS5: the noxfile delegates the constant to pyproject's single source
|
|
# (COVERAGE_THRESHOLD = _read_coverage_fail_under()), so assert the
|
|
# delegation plus the pyproject floor rather than a hardcoded literal.
|
|
${content}= Get File ${WORKSPACE}/noxfile.py
|
|
Should Contain ${content} COVERAGE_THRESHOLD = _read_coverage_fail_under()
|
|
${pyproject}= Get File ${WORKSPACE}/pyproject.toml
|
|
Should Contain ${pyproject} fail_under = 96.5
|
|
|
|
Pyproject Contains Coverage Run Section
|
|
[Documentation] Verify [tool.coverage.run] section exists in pyproject.toml
|
|
[Tags] coverage config
|
|
${content}= Get File ${WORKSPACE}/pyproject.toml
|
|
Should Contain ${content} [tool.coverage.run]
|
|
|
|
Pyproject Has Branch Coverage Enabled
|
|
[Documentation] Verify branch = true is in coverage.run config
|
|
[Tags] coverage config
|
|
${content}= Get File ${WORKSPACE}/pyproject.toml
|
|
Should Contain ${content} branch = true
|
|
|
|
Pyproject Coverage Source Includes Src
|
|
[Documentation] Verify src is in the coverage source list
|
|
[Tags] coverage config
|
|
${content}= Get File ${WORKSPACE}/pyproject.toml
|
|
Should Contain ${content} source = ["src"
|
|
|
|
Coverage Threshold Is 96.5 In Noxfile
|
|
[Documentation] Verify noxfile enforces 96.5% threshold via fail-under
|
|
[Tags] coverage config tdd_issue tdd_issue_4227
|
|
${content}= Get File ${WORKSPACE}/noxfile.py
|
|
Should Contain ${content} --fail-under=
|
|
|
|
Testing Guide Documentation Exists
|
|
[Documentation] Verify docs/development/testing.md was created
|
|
[Tags] coverage docs
|
|
${testing_doc}= Set Variable ${WORKSPACE}/docs/development/testing.md
|
|
File Should Exist ${testing_doc}
|
|
${content}= Get File ${testing_doc}
|
|
Should Contain ${content} 97%
|