TEST-INFRA: [ci-execution-time] Optimize `Robot.Actor Context Management` test suite #1898

New issue

Open

opened 2026-04-03 00:09:53 +00:00 by freemo · 2 comments

freemo commented

2026-04-03 00:09:53 +00:00

Owner

Metadata

Branch: chore/ci-execution-time-optimize-actor-context-mgmt-tests
Commit Message: perf(tests): optimize Robot.Actor Context Management integration test suite execution time
Milestone: v3.8.0
Parent Epic: #1678

Background and Context

The Robot.Actor Context Management test suite in the integration_tests nox session is taking over 147 seconds to complete. This is a significant contributor to the overall execution time of the integration_tests session and directly impacts developer feedback loop speed and CI pipeline throughput.

This issue is part of the broader CI execution time optimization effort tracked in Epic #1678.

Current Behavior

The Robot.Actor Context Management test suite runs for over 147 seconds during the integration_tests nox session. The root cause has not yet been identified — it may be due to slow keyword implementations, excessive sleep/wait calls, lack of parallelism, redundant setup/teardown, or other inefficiencies.

Expected Behavior

The Robot.Actor Context Management test suite execution time is significantly reduced without compromising test quality, coverage, or correctness.

Acceptance Criteria

The execution time of the Robot.Actor Context Management test suite is measurably and significantly reduced compared to the baseline of ~147 seconds.
All tests in the suite continue to pass and cover the same behaviors as before.
No test quality regressions are introduced (no removal of meaningful assertions or coverage gaps).
All nox default sessions pass after the optimization.
Coverage remains ≥ 97%.

Supporting Information

Parent Epic: #1678 — CI Execution Time Optimization — Timeouts, Concurrency, and Coverage Artifact Sharing
The integration_tests nox session runs Robot Framework test suites; the Robot.Actor Context Management suite is the primary bottleneck identified.

Subtasks

Establish a baseline execution time measurement for the Robot.Actor Context Management suite
Profile the suite to identify the slowest keywords, tests, and setup/teardown steps
Investigate root causes: excessive sleeps/waits, redundant setup, missing parallelism, slow fixtures, etc.
Propose and document optimization strategies
Implement approved optimizations (e.g., reduce wait times, parallelize where safe, deduplicate setup)
Re-measure execution time after optimizations and confirm significant reduction
Verify all tests still pass and no coverage regressions exist
Run nox (all default sessions) and fix any errors
Verify coverage ≥ 97% via nox -s coverage_report

Definition of Done

This issue is complete when:

All subtasks above are completed and checked off.
The execution time of the Robot.Actor Context Management test suite is significantly reduced from the ~147 second baseline.
A Git commit is created where the first line of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details about the implementation.
The commit is pushed to the remote on the branch matching the Branch in Metadata exactly.
The commit is submitted as a pull request to master, reviewed, and merged before this issue is marked done.
All nox stages pass.
Coverage ≥ 97%.

Automated by CleverAgents Bot
Supervisor: Test Infrastructure | Agent: ca-new-issue-creator

## Metadata - **Branch**: `chore/ci-execution-time-optimize-actor-context-mgmt-tests` - **Commit Message**: `perf(tests): optimize Robot.Actor Context Management integration test suite execution time` - **Milestone**: v3.8.0 - **Parent Epic**: #1678 ## Background and Context The `Robot.Actor Context Management` test suite in the `integration_tests` nox session is taking over **147 seconds** to complete. This is a significant contributor to the overall execution time of the `integration_tests` session and directly impacts developer feedback loop speed and CI pipeline throughput. This issue is part of the broader CI execution time optimization effort tracked in Epic #1678. ## Current Behavior The `Robot.Actor Context Management` test suite runs for over 147 seconds during the `integration_tests` nox session. The root cause has not yet been identified — it may be due to slow keyword implementations, excessive sleep/wait calls, lack of parallelism, redundant setup/teardown, or other inefficiencies. ## Expected Behavior The `Robot.Actor Context Management` test suite execution time is significantly reduced without compromising test quality, coverage, or correctness. ## Acceptance Criteria - The execution time of the `Robot.Actor Context Management` test suite is measurably and significantly reduced compared to the baseline of ~147 seconds. - All tests in the suite continue to pass and cover the same behaviors as before. - No test quality regressions are introduced (no removal of meaningful assertions or coverage gaps). - All nox default sessions pass after the optimization. - Coverage remains ≥ 97%. ## Supporting Information - Parent Epic: #1678 — CI Execution Time Optimization — Timeouts, Concurrency, and Coverage Artifact Sharing - The `integration_tests` nox session runs Robot Framework test suites; the `Robot.Actor Context Management` suite is the primary bottleneck identified. ## Subtasks - [ ] Establish a baseline execution time measurement for the `Robot.Actor Context Management` suite - [ ] Profile the suite to identify the slowest keywords, tests, and setup/teardown steps - [ ] Investigate root causes: excessive sleeps/waits, redundant setup, missing parallelism, slow fixtures, etc. - [ ] Propose and document optimization strategies - [ ] Implement approved optimizations (e.g., reduce wait times, parallelize where safe, deduplicate setup) - [ ] Re-measure execution time after optimizations and confirm significant reduction - [ ] Verify all tests still pass and no coverage regressions exist - [ ] Run `nox` (all default sessions) and fix any errors - [ ] Verify coverage ≥ 97% via `nox -s coverage_report` ## Definition of Done This issue is complete when: - All subtasks above are completed and checked off. - The execution time of the `Robot.Actor Context Management` test suite is significantly reduced from the ~147 second baseline. - A Git commit is created where the **first line** of the commit message matches the Commit Message in Metadata exactly, followed by a blank line, then additional lines providing relevant details about the implementation. - The commit is pushed to the remote on the branch matching the **Branch** in Metadata exactly. - The commit is submitted as a **pull request** to `master`, reviewed, and **merged** before this issue is marked done. - All nox stages pass. - Coverage ≥ 97%. --- **Automated by CleverAgents Bot** Supervisor: Test Infrastructure | Agent: ca-new-issue-creator

freemo added this to the v3.8.0 milestone

2026-04-03 00:10:00 +00:00

freemo commented

2026-04-03 00:12:36 +00:00

Author

Owner

Issue triaged by project owner:

State: Verified
MoSCoW: MoSCoW/Could Have — CI/test infrastructure improvement.

Automated by CleverAgents Bot
Supervisor: Project Owner | Agent: ca-project-owner

Issue triaged by project owner: - **State**: Verified - **MoSCoW**: MoSCoW/Could Have — CI/test infrastructure improvement. --- **Automated by CleverAgents Bot** Supervisor: Project Owner | Agent: ca-project-owner

freemo added the

MoSCoW

Could have

label

2026-04-03 00:12:37 +00:00

freemo added a new dependency

2026-04-03 00:14:07 +00:00

#1678 Epic: CI Execution Time Optimization — Timeouts, Concurrency, and Coverage Artifact Sharing

freemo commented

2026-04-03 00:19:34 +00:00

Author

Owner