Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PoC: Run E2E tests with WP Playground #62692

Draft
wants to merge 30 commits into
base: trunk
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
30 commits
Select commit Hold shift + click to select a range
0399391
modify config to run against Playground
WunderBart Jun 20, 2024
e226d20
upload e2e blueprint
WunderBart Jun 20, 2024
467a732
try running e2e tests w/ Playground in CI
WunderBart Jun 20, 2024
5416734
make the test report verbose
WunderBart Jun 20, 2024
12a8ac7
run single suite for testing
WunderBart Jun 20, 2024
582c72c
try checking out PG repo aside
WunderBart Jun 20, 2024
2991126
Revert "try checking out PG repo aside"
WunderBart Jun 20, 2024
187acdf
restore global setup for pre-auth
WunderBart Jun 20, 2024
4e2de6d
add missing dir change
WunderBart Jun 20, 2024
a54920c
Revert "run single suite for testing"
WunderBart Jun 20, 2024
a34384e
disable retries to finish faster avoid flaky reports
WunderBart Jun 20, 2024
e0f6e89
Merge remote-tracking branch 'origin' into try/run-e2e-tests-against-…
WunderBart Oct 3, 2024
a78b728
Use the @wp-playground/cli package
WunderBart Oct 3, 2024
df7d403
Add db connection retry
WunderBart Oct 3, 2024
49cfa8d
Wait for the server to be fully provisioned
WunderBart Oct 3, 2024
1e0155b
Provision server with node
WunderBart Oct 3, 2024
6dca9a6
Ignore the `Downloading ...` log noise
WunderBart Oct 3, 2024
1613cbb
Don't print progress logs
WunderBart Oct 3, 2024
e003621
Debug pw:api
WunderBart Oct 3, 2024
b294df5
Try older php
WunderBart Oct 4, 2024
4fe28bb
Fix log exclusion
WunderBart Oct 4, 2024
bfbc5fa
Try POST instead of PUT for plugin activation
WunderBart Oct 4, 2024
80e61be
Revert "Try POST instead of PUT for plugin activation"
WunderBart Oct 4, 2024
9ca0fbb
disable pw:api logs
WunderBart Oct 4, 2024
ef07ba4
Revert "Add db connection retry"
WunderBart Oct 4, 2024
8549d76
try: Run only one shard
WunderBart Oct 6, 2024
19d223f
try: Make shards smaller
WunderBart Oct 6, 2024
d92a140
tmp: run just 1 suite
WunderBart Oct 6, 2024
3e48cba
tmp: run 2 suites :)
WunderBart Oct 6, 2024
15689a1
try: run 3 suites :))
WunderBart Oct 6, 2024
File filter

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 8 additions & 6 deletions .github/workflows/end2end-test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -23,8 +23,9 @@ jobs:
strategy:
fail-fast: false
matrix:
part: [1, 2, 3, 4, 5, 6, 7, 8]
totalParts: [8]
# part: [1, 2, 3, 4, 5, 6, 7, 8]
part: [1]
totalParts: [24]

steps:
- uses: actions/checkout@d632683dd7b4114ad314bca15554477dd762a938 # v4.2.0
Expand All @@ -41,15 +42,16 @@ jobs:
run: |
npx playwright install chromium firefox webkit --with-deps

- name: Install WordPress and start the server
run: |
npm run wp-env start
- name: Start the server
run: node playground-server.js

- name: Run the tests
env:
PLAYWRIGHT_SKIP_BROWSER_DOWNLOAD: 1
run: |
xvfb-run --auto-servernum --server-args="-screen 0 1280x960x24" -- npm run test:e2e -- --shard=${{ matrix.part }}/${{ matrix.totalParts }}
WP_BASE_URL=http://127.0.0.1:9400/ \
xvfb-run --auto-servernum --server-args="-screen 0 1280x960x24" -- \
npm run test:e2e -- editor/blocks/buttons.spec.js editor/blocks/code.spec.js editor/blocks/classic.spec.js

- name: Archive debug artifacts (screenshots, traces)
uses: actions/upload-artifact@65462800fd760344b1a7b4382951275a0abb4808 # v4.3.3
Expand Down
Loading
Loading