Skip to content

wpt: Use Webdriver for all WPT runs #56920

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
servo-wpt-sync wants to merge 1 commit into
base: master
Choose a base branch
from

wpt: Use Webdriver for all WPT runs

fa0f47b
Select commit
Loading
Failed to load commit list.
Open

wpt: Use Webdriver for all WPT runs #56920

wpt: Use Webdriver for all WPT runs
fa0f47b
Select commit
Loading
Failed to load commit list.
Community-TC Integration / infrastructure/ tests (chrome) failed Dec 24, 2025 in 8m 5s

Community-TC (pull_request)

Smoketests for wptrunner in chrome.

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2025-12-24T18:31:52.142Z
Resolved: 2025-12-24T18:36:51.757Z
Task Execution Time: 4 minutes, 59 seconds, 615 milliseconds
Task Status: failed
Reason Resolved: failed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md
- public/results/wptreport-chrome.json

WPT Command: python3 ./wpt run --log-tbpl=- --log-wptreport=../artifacts/wptreport-chrome.json --logcat-dir=../artifacts/ --metadata=infrastructure/metadata/ --include=infrastructure/ --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --verify-log-full --no-headless --enable-swiftshader --install-browser --install-webdriver chrome

[taskcluster 2025-12-24 18:31:52.255Z] Task ID: YzffKXwCQNS_rXyCcVuofA
[taskcluster 2025-12-24 18:31:52.255Z] Worker ID: 5589300327034752898
[taskcluster 2025-12-24 18:31:52.255Z] Worker Group: us-east1-c
[taskcluster 2025-12-24 18:31:52.255Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2025-12-24 18:31:52.255Z] Worker Pool: proj-wpt/ci
[taskcluster 2025-12-24 18:31:52.255Z] Worker Version: 46.1.0
[taskcluster 2025-12-24 18:31:52.255Z] Public IP: 34.75.246.215
[taskcluster 2025-12-24 18:31:52.255Z] Hostname: proj-wpt-ci-cnj85ml-tssio3pbohio0a

ac811f28856d - Started downloading
8f84a9f2102e - Started downloading
ac811f28856d - Downloaded in 0.035 seconds
40516d781e70 - Started downloading
44ebbf800033 - Started downloading
44ebbf800033 - Downloaded in 0.05 seconds
8f84a9f2102e - Downloaded in 0.199 seconds
4f4fb700ef54 - Started downloading
4f4fb700ef54 - Downloaded in 0 seconds
a8884b21e40e - Started downloading
79c347416ee8 - Started downloading

...(2573 lines hidden)...

TEST-KNOWN-INTERMITTENT-FAIL | /infrastructure/testdriver/click_iframe_crossorigin.sub.html | TestDriver click on a document in an iframe - Uncaught Error: assert_unreached: click failed Reached unreachable code
    at http://web-platform.test:8000/infrastructure/testdriver/click_iframe_crossorigin.sub.html:15:9
 2:37.78 TEST_END: Test OK. Subtests passed 0/1. Unexpected 0
KNOWN-INTERMITTENT-FAIL TestDriver click on a document in an iframe - Uncaught Error: assert_unreached: click failed Reached unreachable code
    at http://web-platform.test:8000/infrastructure/testdriver/click_iframe_crossorigin.sub.html:15:9

TEST-OK | /infrastructure/testdriver/click_iframe_crossorigin.sub.html | took 324ms
 2:37.79 TEST_START: /infrastructure/testdriver/click_nested.html
TEST-START | /infrastructure/testdriver/click_nested.html
TEST-PASS | /infrastructure/testdriver/click_nested.html | TestDriver click method with multiple windows and nested iframe 
 2:38.77 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/click_nested.html | took 982ms
 2:38.77 TEST_START: /infrastructure/testdriver/click_nested_crossorigin.sub.html
TEST-START | /infrastructure/testdriver/click_nested_crossorigin.sub.html
 2:38.81 pid:5978 [6025:6025:1224/183639.416635:ERROR:gpu/command_buffer/service/shared_image/shared_image_manager.cc:397] SharedImageManager::ProduceSkia: Trying to Produce a Skia representation from a non-existent mailbox.
PID 5978 | [6025:6025:1224/183639.416635:ERROR:gpu/command_buffer/service/shared_image/shared_image_manager.cc:397] SharedImageManager::ProduceSkia: Trying to Produce a Skia representation from a non-existent mailbox.
 2:39.78 pid:5978 [6025:6025:1224/183640.389836:ERROR:gpu/command_buffer/service/shared_image/shared_image_manager.cc:397] SharedImageManager::ProduceSkia: Trying to Produce a Skia representation from a non-existent mailbox.
PID 5978 | [6025:6025:1224/183640.389836:ERROR:gpu/command_buffer/service/shared_image/shared_image_manager.cc:397] SharedImageManager::ProduceSkia: Trying to Produce a Skia representation from a non-existent mailbox.
 2:39.78 pid:5978 [6025:6025:1224/183640.391401:ERROR:gpu/command_buffer/service/shared_image/shared_image_manager.cc:397] SharedImageManager::ProduceSkia: Trying to Produce a Skia representation from a non-existent mailbox.
PID 5978 | [6025:6025:1224/183640.391401:ERROR:gpu/command_buffer/service/shared_image/shared_image_manager.cc:397] SharedImageManager::ProduceSkia: Trying to Produce a Skia representation from a non-existent mailbox.
TEST-PASS | /infrastructure/testdriver/click_nested_crossorigin.sub.html | TestDriver click method with multiple windows and nested iframe 
 2:39.82 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/click_nested_crossorigin.sub.html | took 1053ms
 2:39.82 TEST_START: /infrastructure/testdriver/click_window.html
TEST-START | /infrastructure/testdriver/click_window.html
TEST-PASS | /infrastructure/testdriver/click_window.html | TestDriver click method in window 
 2:40.53 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/click_window.html | took 703ms
 2:40.53 TEST_START: /infrastructure/testdriver/delete_all_cookies.html
TEST-START | /infrastructure/testdriver/delete_all_cookies.html
 2:40.53 pid:5978 [6025:6025:1224/183641.139088:ERROR:gpu/command_buffer/service/shared_image/shared_image_manager.cc:397] SharedImageManager::ProduceSkia: Trying to Produce a Skia representation from a non-existent mailbox.
PID 5978 | [6025:6025:1224/183641.139088:ERROR:gpu/command_buffer/service/shared_image/shared_image_manager.cc:397] SharedImageManager::ProduceSkia: Trying to Produce a Skia representation from a non-existent mailbox.
TEST-PASS | /infrastructure/testdriver/delete_all_cookies.html | DOM-set cookies get deleted 
TEST-PASS | /infrastructure/testdriver/delete_all_cookies.html | HTTP-set cookies get deleted 
 2:41.06 TEST_END: Test OK. Subtests passed 2/2. Unexpected 0
TEST-OK | /infrastructure/testdriver/delete_all_cookies.html | took 529ms
 2:41.06 TEST_START: /infrastructure/testdriver/file_upload.sub.html
TEST-START | /infrastructure/testdriver/file_upload.sub.html
TEST-PASS | /infrastructure/testdriver/file_upload.sub.html | File upload using testdriver 
 2:41.50 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/file_upload.sub.html | took 444ms
 2:41.50 TEST_START: /infrastructure/testdriver/generate_test_report.html
TEST-START | /infrastructure/testdriver/generate_test_report.html
TEST-PASS | /infrastructure/testdriver/generate_test_report.html | TestDriver generate_test_report method 
 2:41.90 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/generate_test_report.html | took 403ms
 2:41.90 TEST_START: /infrastructure/testdriver/get_all_cookies.sub.html
TEST-START | /infrastructure/testdriver/get_all_cookies.sub.html
TEST-PASS | /infrastructure/testdriver/get_all_cookies.sub.html | Get all HTTP cookies 
 2:42.28 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_all_cookies.sub.html | took 380ms
 2:42.28 TEST_START: /infrastructure/testdriver/get_all_cookies.sub.https.html
TEST-START | /infrastructure/testdriver/get_all_cookies.sub.https.html
TEST-PASS | /infrastructure/testdriver/get_all_cookies.sub.https.html | Get all HTTPS cookies 
 2:42.76 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_all_cookies.sub.https.html | took 476ms
 2:42.76 TEST_START: /infrastructure/testdriver/get_named_cookie.sub.html
TEST-START | /infrastructure/testdriver/get_named_cookie.sub.html
TEST-PASS | /infrastructure/testdriver/get_named_cookie.sub.html | Get Named HTTP cookie 
 2:43.38 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_named_cookie.sub.html | took 622ms
 2:43.38 TEST_START: /infrastructure/testdriver/get_named_cookie.sub.https.html
TEST-START | /infrastructure/testdriver/get_named_cookie.sub.https.html
TEST-PASS | /infrastructure/testdriver/get_named_cookie.sub.https.html | Get Named HTTPS cookie 
 2:43.97 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_named_cookie.sub.https.html | took 584ms
 2:43.97 TEST_START: /infrastructure/testdriver/send_keys.html
TEST-START | /infrastructure/testdriver/send_keys.html
TEST-PASS | /infrastructure/testdriver/send_keys.html | TestDriver send keys method 
 2:44.56 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/send_keys.html | took 593ms
 2:44.56 TEST_START: /infrastructure/testdriver/set_get_window_rect.html
TEST-START | /infrastructure/testdriver/set_get_window_rect.html
TEST-PASS | /infrastructure/testdriver/set_get_window_rect.html | Window Position 
TEST-PASS | /infrastructure/testdriver/set_get_window_rect.html | Window Size 
 2:45.01 TEST_END: Test OK. Subtests passed 2/2. Unexpected 0
TEST-OK | /infrastructure/testdriver/set_get_window_rect.html | took 449ms
 2:45.01 TEST_START: /infrastructure/testdriver/set_permission.https.html
TEST-START | /infrastructure/testdriver/set_permission.https.html
TEST-PASS | /infrastructure/testdriver/set_permission.https.html | Grant Permission 
TEST-PASS | /infrastructure/testdriver/set_permission.https.html | Deny Permission 
 2:45.44 TEST_END: Test OK. Subtests passed 2/2. Unexpected 0
TEST-OK | /infrastructure/testdriver/set_permission.https.html | took 424ms
 2:45.44 TEST_START: /infrastructure/testdriver/virtual_authenticator.html
TEST-START | /infrastructure/testdriver/virtual_authenticator.html
mem avail: 14063 of 15806 MiB (88.97%), swap free:    0 of    0 MiB ( 0.00%)
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can create an authenticator 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can add a credential 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can get the credentials 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can remove a credential 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can remove all credentials 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can set user verified 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can remove a virtual authenticator 
 2:46.04 TEST_END: Test OK. Subtests passed 7/7. Unexpected 0
TEST-OK | /infrastructure/testdriver/virtual_authenticator.html | took 599ms
 2:46.04 TEST_START: /infrastructure/testharness/full.stop/full-stop.html
TEST-START | /infrastructure/testharness/full.stop/full-stop.html
TEST-PASS | /infrastructure/testharness/full.stop/full-stop.html | full-stop 
 2:46.44 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testharness/full.stop/full-stop.html | took 407ms
 2:46.44 TEST_START: /infrastructure/testharness/lone-surrogates.html
TEST-START | /infrastructure/testharness/lone-surrogates.html
TEST-PASS | /infrastructure/testharness/lone-surrogates.html | passing test with lone surrogate U+d800 in name 
TEST-FAIL | /infrastructure/testharness/lone-surrogates.html | failing test with lone surrogate U+d800 in name - assert_true: expected true got false
    at Test.<anonymous> (http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:7:14)
    at Test.step (http://web-platform.test:8000/resources/testharness.js:2869:25)
    at test (http://web-platform.test:8000/resources/testharness.js:633:30)
    at http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:7:3
TEST-PASS | /infrastructure/testharness/lone-surrogates.html | passing test with lone surrogate in assert 
TEST-FAIL | /infrastructure/testharness/lone-surrogates.html | failing test with lone surrogate in assert - assert_true: lone U+d800 surrogate expected true got false
    at Test.<anonymous> (http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:9:14)
    at Test.step (http://web-platform.test:8000/resources/testharness.js:2869:25)
    at test (http://web-platform.test:8000/resources/testharness.js:633:30)
    at http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:9:3
 2:46.76 TEST_END: Test OK. Subtests passed 2/4. Unexpected 0
TEST-OK | /infrastructure/testharness/lone-surrogates.html | took 317ms
 2:46.76 TEST_START: /infrastructure/window/minimize-1.html
TEST-START | /infrastructure/window/minimize-1.html
TEST-PASS | /infrastructure/window/minimize-1.html | Minimize a window 
 2:47.22 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/window/minimize-1.html | took 452ms
 2:47.22 TEST_START: /infrastructure/window/minimize-2.html
TEST-START | /infrastructure/window/minimize-2.html
 2:47.42 pid:5978 [5995:6010:1224/183648.033133:ERROR:google_apis/gcm/engine/registration_request.cc:291] Registration response error message: PHONE_REGISTRATION_ERROR
PID 5978 | [5995:6010:1224/183648.033133:ERROR:google_apis/gcm/engine/registration_request.cc:291] Registration response error message: PHONE_REGISTRATION_ERROR
 2:47.42 pid:5978 [5995:6010:1224/183648.033184:ERROR:google_apis/gcm/engine/registration_request.cc:291] Registration response error message: PHONE_REGISTRATION_ERROR
PID 5978 | [5995:6010:1224/183648.033184:ERROR:google_apis/gcm/engine/registration_request.cc:291] Registration response error message: PHONE_REGISTRATION_ERROR
 2:47.42 pid:5978 [5995:6010:1224/183648.034650:ERROR:google_apis/gcm/engine/mcs_client.cc:700]   Error code: 401  Error message: Authentication Failed: wrong_secret
PID 5978 | [5995:6010:1224/183648.034650:ERROR:google_apis/gcm/engine/mcs_client.cc:700]   Error code: 401  Error message: Authentication Failed: wrong_secret
 2:47.43 pid:5978 [5995:6010:1224/183648.034662:ERROR:google_apis/gcm/engine/mcs_client.cc:702] Failed to log in to GCM, resetting connection.
PID 5978 | [5995:6010:1224/183648.034662:ERROR:google_apis/gcm/engine/mcs_client.cc:702] Failed to log in to GCM, resetting connection.
 2:47.43 pid:5978 [5995:6010:1224/183648.035927:ERROR:google_apis/gcm/engine/registration_request.cc:291] Registration response error message: PHONE_REGISTRATION_ERROR
PID 5978 | [5995:6010:1224/183648.035927:ERROR:google_apis/gcm/engine/registration_request.cc:291] Registration response error message: PHONE_REGISTRATION_ERROR
TEST-PASS | /infrastructure/window/minimize-2.html | Use testdriver to check window is not minimized 
 2:47.61 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/window/minimize-2.html | took 391ms
 2:47.61 INFO No more tests
No more tests
 2:47.67 INFO Closing logging queue
Closing logging queue
 2:47.67 INFO queue closed
queue closed
 2:47.75 SUITE_END

web-platform-test
~~~~~~~~~~~~~~~~~
Ran 439 checks (252 subtests, 187 tests)
Expected results: 436 (1 known intermittents)
Skipped: 2 tests
Unexpected results: 1
  subtest: 1 (1 fail)

Known Intermittent Results
--------------------------
/infrastructure/testdriver/click_iframe_crossorigin.sub.html
  KNOWN-INTERMITTENT-FAIL TestDriver click on a document in an iframe - Uncaught Error: assert_unreached: click failed Reached unreachable code
    at http://web-platform.test:8000/infrastructure/testdriver/click_iframe_crossorigin.sub.html:15:9

Unexpected Results
------------------
/infrastructure/testdriver/bidi/subscription.html
  FAIL Assert testdriver can subscribe globally - assert_equals: expected "2. POPUP MESSAGE" but got "1. MAIN WINDOW MESSAGE"
    at assertLogEvent (http://web-platform.test:8000/infrastructure/testdriver/bidi/subscription.html:19:9)
    at Test.<anonymous> (http://web-platform.test:8000/infrastructure/testdriver/bidi/subscription.html:135:9)
SUITE-END | took 153s
 2:47.75 INFO Got 1 unexpected results, with 0 unexpected passes
Got 1 unexpected results, with 0 unexpected passes
 2:47.75 wptserve INFO Stopped http server on 127.0.0.1:8001
wptserve Stopped http server on 127.0.0.1:8001
 2:47.75 wptserve INFO Stopped http server on 127.0.0.1:8002
wptserve Stopped http server on 127.0.0.1:8002
 2:47.75 wptserve INFO Stopped http server on 127.0.0.1:8000
wptserve Stopped http server on 127.0.0.1:8000
 2:47.76 wptserve INFO Stopped http server on 127.0.0.1:8003
wptserve Stopped http server on 127.0.0.1:8003
 2:47.76 wptserve INFO Stopped http server on 127.0.0.1:8446
wptserve Stopped http server on 127.0.0.1:8446
 2:47.77 wptserve INFO Stopped http server on 127.0.0.1:8445
wptserve Stopped http server on 127.0.0.1:8445
 2:47.77 wptserve INFO Stopped http server on 127.0.0.1:8444
wptserve Stopped http server on 127.0.0.1:8444
 2:47.77 wptserve INFO Stopped http server on 127.0.0.1:8443
wptserve Stopped http server on 127.0.0.1:8443
 2:47.78 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
wptserve Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
 2:47.82 wptserve INFO Stopped http server on 127.0.0.1:9000
wptserve Stopped http server on 127.0.0.1:9000
 2:47.99 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 2:48.21 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 2:48.25 INFO Removed font: Ahem.ttf
Removed font: Ahem.ttf
 2:48.28 INFO Closing logging queue
Closing logging queue
 2:48.28 INFO queue closed
queue closed
[taskcluster 2025-12-24 18:36:50.194Z] === Task Finished ===
[taskcluster 2025-12-24 18:36:50.913Z] Unsuccessful task run with exit code: 1 completed in 298.66 seconds
View more details on Community-TC Integration