TEST-INFRA: [ci-pipeline-design] Add comprehensive Helm chart testing with a real cluster #1800

New issue

Open

opened 2026-04-02 23:52:25 +00:00 by freemo · 1 comment

freemo commented

2026-04-02 23:52:25 +00:00

Owner

The helm job in the CI pipeline currently lints and smoke tests the Helm chart. While this is a good start, it does not provide a high level of confidence that the chart is working correctly.

To improve this, we should add more comprehensive tests that deploy the chart to a real Kubernetes cluster and run integration tests against it. This will help to catch a wider range of issues and ensure that the chart is production-ready.

Subtasks

Set up a test Kubernetes cluster in the CI environment.
Update the helm job to deploy the Helm chart to the test cluster.
Add a new job to run integration tests against the deployed application.
The integration tests should verify the functionality of the application and the correctness of the Kubernetes resources.

Definition of Done

The Helm chart is tested against a real Kubernetes cluster.
The CI pipeline includes integration tests for the Helm chart.
The Helm chart is more reliable and production-ready.

Automated by CleverAgents Bot
Supervisor: Test Infrastructure | Agent: ca-test-infra-improper

The `helm` job in the CI pipeline currently lints and smoke tests the Helm chart. While this is a good start, it does not provide a high level of confidence that the chart is working correctly. To improve this, we should add more comprehensive tests that deploy the chart to a real Kubernetes cluster and run integration tests against it. This will help to catch a wider range of issues and ensure that the chart is production-ready. ### Subtasks - [ ] Set up a test Kubernetes cluster in the CI environment. - [ ] Update the `helm` job to deploy the Helm chart to the test cluster. - [ ] Add a new job to run integration tests against the deployed application. - [ ] The integration tests should verify the functionality of the application and the correctness of the Kubernetes resources. ### Definition of Done - The Helm chart is tested against a real Kubernetes cluster. - The CI pipeline includes integration tests for the Helm chart. - The Helm chart is more reliable and production-ready. --- **Automated by CleverAgents Bot** Supervisor: Test Infrastructure | Agent: ca-test-infra-improper

freemo referenced this issue

2026-04-03 00:07:06 +00:00

[Automated] Backlog Groomer Session State — v3.7.0 #1463

freemo commented

2026-04-03 00:27:15 +00:00

Author

Owner

Issue triaged by project owner:

State: Verified
MoSCoW: MoSCoW/Could Have — CI/test infrastructure improvement.

Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: ca-project-owner

Issue triaged by project owner: - **State**: Verified - **MoSCoW**: MoSCoW/Could Have — CI/test infrastructure improvement. --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: ca-project-owner

freemo added the

MoSCoW

Could have

label

2026-04-03 00:27:15 +00:00