Fix validation bypass for code longer than 10 characters — the length fallback was overriding LLM-based FAIL verdicts and rendering validation ineffective
CI / push-validation (push) Successful in 49s
CI / benchmark-regression (push) Failing after 1m36s
CI / benchmark-publish (push) Successful in 1h20m14s
CI / tdd_quality_gate (push) Has been skipped
CI / e2e_tests (push) Successful in 4m55s
CI / unit_tests (push) Successful in 8m57s
CI / lint (push) Failing after 26m11s
CI / integration_tests (push) Failing after 4m56s
CI / push-validation (pull_request) Successful in 48s
CI / tdd_quality_gate (pull_request) Failing after 1m19s
CI / integration_tests (pull_request) Failing after 4m36s
CI / e2e_tests (pull_request) Successful in 5m16s
CI / unit_tests (pull_request) Successful in 6m41s
CI / helm (push) Failing after 16m22s
CI / security (push) Failing after 16m52s
CI / quality (push) Failing after 16m52s
CI / build (push) Failing after 16m51s
CI / typecheck (push) Failing after 17m2s
CI / docker (push) Has been skipped
CI / coverage (push) Has been skipped
CI / status-check (push) Failing after 3s
CI / helm (pull_request) Failing after 16m0s
CI / build (pull_request) Failing after 16m31s
CI / security (pull_request) Failing after 16m38s
CI / lint (pull_request) Failing after 16m38s
CI / typecheck (pull_request) Failing after 16m41s
CI / quality (pull_request) Failing after 16m43s
CI / coverage (pull_request) Has been skipped
CI / docker (pull_request) Has been skipped
CI / status-check (pull_request) Failing after 3s
CI / push-validation (push) Successful in 49s
CI / benchmark-regression (push) Failing after 1m36s
CI / benchmark-publish (push) Successful in 1h20m14s
CI / tdd_quality_gate (push) Has been skipped
CI / e2e_tests (push) Successful in 4m55s
CI / unit_tests (push) Successful in 8m57s
CI / lint (push) Failing after 26m11s
CI / integration_tests (push) Failing after 4m56s
CI / push-validation (pull_request) Successful in 48s
CI / tdd_quality_gate (pull_request) Failing after 1m19s
CI / integration_tests (pull_request) Failing after 4m36s
CI / e2e_tests (pull_request) Successful in 5m16s
CI / unit_tests (pull_request) Successful in 6m41s
CI / helm (push) Failing after 16m22s
CI / security (push) Failing after 16m52s
CI / quality (push) Failing after 16m52s
CI / build (push) Failing after 16m51s
CI / typecheck (push) Failing after 17m2s
CI / docker (push) Has been skipped
CI / coverage (push) Has been skipped
CI / status-check (push) Failing after 3s
CI / helm (pull_request) Failing after 16m0s
CI / build (pull_request) Failing after 16m31s
CI / security (pull_request) Failing after 16m38s
CI / lint (pull_request) Failing after 16m38s
CI / typecheck (pull_request) Failing after 16m41s
CI / quality (pull_request) Failing after 16m43s
CI / coverage (pull_request) Has been skipped
CI / docker (pull_request) Has been skipped
CI / status-check (pull_request) Failing after 3s
This commit is contained in:
@@ -527,8 +527,8 @@ class PlanGenerationGraph:
|
||||
)
|
||||
validation = str(result)
|
||||
|
||||
# Simple validation check (in real implementation, parse the LLM response)
|
||||
is_valid = "PASS" in validation.upper() or len(all_code) > 10
|
||||
# Reliance on the LLM response to determine pass/fail.
|
||||
is_valid = "PASS" in validation.upper()
|
||||
|
||||
return {
|
||||
"validation_result": {
|
||||
|
||||
Reference in New Issue
Block a user