Skip to content

(e2e-testing): Make fewer GitHub actions when setting up e2e-testing#21547

Open
alexjoel42 wants to merge 4 commits into
edgefrom
deployment_time_saver
Open

(e2e-testing): Make fewer GitHub actions when setting up e2e-testing#21547
alexjoel42 wants to merge 4 commits into
edgefrom
deployment_time_saver

Conversation

@alexjoel42
Copy link
Copy Markdown
Contributor

@alexjoel42 alexjoel42 commented May 19, 2026

Overview

Broke pd_server out of conftest.py and added Xdist
https://opentrons.atlassian.net/browse/RQA-5458

Python/Make setup edits

  • Add 2 runners using xdist.
  • Xdist
  • Added a new file called pd_server.py to be the PD server.
  • Made a small adjustment so that both Xdist runners are in the same applitools batch

Testing

  • e2e-testing along used to take 12 minutes
  • Now it takes 5 minutes
  • Reran tests to ensure that e2e-testing still used the pd cache.
  • Used Applitools to ensure batching worked the same way

We formerly included the full setup-js but now I'm going to try and have it take a shorter set up
time by only using what's necessary for e2e-testing
@codecov
Copy link
Copy Markdown

codecov Bot commented May 20, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 21.12%. Comparing base (a066952) to head (7b3b287).
⚠️ Report is 3 commits behind head on edge.

Additional details and impacted files

Impacted file tree graph

@@           Coverage Diff           @@
##             edge   #21547   +/-   ##
=======================================
  Coverage   21.12%   21.12%           
=======================================
  Files        3911     3911           
  Lines      327221   327221           
  Branches    58192    58189    -3     
=======================================
  Hits        69140    69140           
  Misses     255112   255112           
  Partials     2969     2969           
Flag Coverage Δ
protocol-designer 39.79% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@alexjoel42 alexjoel42 requested a review from y3rsh May 20, 2026 15:16
@alexjoel42 alexjoel42 marked this pull request as ready for review May 20, 2026 15:19
Copy link
Copy Markdown
Member

@y3rsh y3rsh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good ideas, thank you. There is a competing strategy to this one where we use multiple jobs in the workflow that run in || against groups of tests. We can try this first using xdist in 1 job.

Comment thread .github/workflows/pd-e2e-test.yaml Outdated
Comment thread .github/workflows/pd-e2e-test.yaml Outdated
Comment thread .github/workflows/pd-e2e-test.yaml Outdated
Move PD preview startup out of conftest into pd_server.py with make serve-pd.
Pytest discovers an existing server for xdist. CI uses js/setup and
make test-pd-local (no separate dist step or CI-only bash).

Co-authored-by: Cursor <cursoragent@cursor.com>
@y3rsh y3rsh self-requested a review May 22, 2026 21:22
Copy link
Copy Markdown
Member

@y3rsh y3rsh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If this is all good locally and LL tests also still run locally and in CI then approved.
It will be easiest if you wait and merge target this to chore_release-9.1.0 and then merge it after #21582

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants