Skip to content

wpt: Use Webdriver for all WPT runs #56920

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
servo-wpt-sync wants to merge 1 commit into
base: master
Choose a base branch
from

wpt: Use Webdriver for all WPT runs

fa0f47b
Select commit
Loading
Failed to load commit list.
Open

wpt: Use Webdriver for all WPT runs #56920

wpt: Use Webdriver for all WPT runs
fa0f47b
Select commit
Loading
Failed to load commit list.
Community-TC Integration / infrastructure/ tests (firefox) succeeded Dec 24, 2025 in 15m 8s

Community-TC (pull_request)

Smoketests for wptrunner in firefox.

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2025-12-24T18:35:17.649Z
Resolved: 2025-12-24T18:43:55.417Z
Task Execution Time: 8 minutes, 37 seconds, 768 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md
- public/results/wptreport-firefox.json.gz

WPT Command: python3 ./wpt run --log-tbpl=- --log-wptreport=../artifacts/wptreport-firefox.json --logcat-dir=../artifacts/ --metadata=infrastructure/metadata/ --include=infrastructure/ --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --verify-log-full --no-headless --binary=/home/test/build/firefox/firefox firefox

[taskcluster 2025-12-24 18:35:17.715Z] Task ID: SslZhJBdSCuzQpsnI-WvOg
[taskcluster 2025-12-24 18:35:17.715Z] Worker ID: 7405349582254739634
[taskcluster 2025-12-24 18:35:17.715Z] Worker Group: us-east1-d
[taskcluster 2025-12-24 18:35:17.715Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2025-12-24 18:35:17.715Z] Worker Pool: proj-wpt/ci
[taskcluster 2025-12-24 18:35:17.715Z] Worker Version: 46.1.0
[taskcluster 2025-12-24 18:35:17.715Z] Public IP: 34.138.197.158
[taskcluster 2025-12-24 18:35:17.715Z] Hostname: proj-wpt-ci-uemolpqrra-v4taiqlcdeg

[taskcluster 2025-12-24 18:35:18.698Z] === Task Starting ===
+ '[' '' ']'
+ '[' -d /etc/profile.d ']'
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/01-locale-fix.sh ']'
+ . /etc/profile.d/01-locale-fix.sh
+++ /usr/bin/locale-check C.UTF-8
++ eval
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/apps-bin-path.sh ']'
+ . /etc/profile.d/apps-bin-path.sh

...(3976 lines hidden)...

 4:45.04 INFO Getting all cookies
Getting all cookies
 4:45.04 INFO Deleting all cookies
Deleting all cookies
TEST-PASS | /infrastructure/testdriver/get_all_cookies.sub.html | Get all HTTP cookies 
 4:45.06 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_all_cookies.sub.html | took 200ms
 4:45.06 TEST_START: /infrastructure/testdriver/get_all_cookies.sub.https.html
TEST-START | /infrastructure/testdriver/get_all_cookies.sub.https.html
 4:45.06 INFO Closing window 93a38c25-ed00-4343-a140-81eea6de70e0
Closing window 93a38c25-ed00-4343-a140-81eea6de70e0
 4:45.49 INFO Getting all cookies
Getting all cookies
 4:45.50 INFO Deleting all cookies
Deleting all cookies
TEST-PASS | /infrastructure/testdriver/get_all_cookies.sub.https.html | Get all HTTPS cookies 
 4:45.51 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_all_cookies.sub.https.html | took 450ms
 4:45.51 TEST_START: /infrastructure/testdriver/get_named_cookie.sub.html
TEST-START | /infrastructure/testdriver/get_named_cookie.sub.html
 4:45.51 INFO Closing window 05696e28-5a5c-4b2d-9853-a8379aca1625
Closing window 05696e28-5a5c-4b2d-9853-a8379aca1625
 4:45.67 INFO Getting cookie named test0
Getting cookie named test0
 4:45.67 INFO Getting cookie named test1
Getting cookie named test1
 4:45.68 INFO Getting cookie named test2
Getting cookie named test2
 4:45.69 INFO Getting cookie named test3
Getting cookie named test3
 4:45.69 INFO Getting cookie named test4
Getting cookie named test4
 4:45.70 INFO Getting cookie named test5
Getting cookie named test5
 4:45.70 INFO Getting cookie named test6
Getting cookie named test6
 4:45.71 INFO Getting cookie named test7
Getting cookie named test7
 4:45.72 INFO Deleting all cookies
Deleting all cookies
TEST-PASS | /infrastructure/testdriver/get_named_cookie.sub.html | Get Named HTTP cookie 
 4:45.73 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_named_cookie.sub.html | took 219ms
 4:45.73 TEST_START: /infrastructure/testdriver/get_named_cookie.sub.https.html
TEST-START | /infrastructure/testdriver/get_named_cookie.sub.https.html
 4:45.73 INFO Closing window 5443ea70-d6c8-4c51-a539-7944783f3c5a
Closing window 5443ea70-d6c8-4c51-a539-7944783f3c5a
 4:45.93 INFO Getting cookie named test0
Getting cookie named test0
 4:45.94 INFO Getting cookie named test1
Getting cookie named test1
 4:45.94 INFO Getting cookie named test2
Getting cookie named test2
 4:45.95 INFO Getting cookie named test3
Getting cookie named test3
 4:45.95 INFO Getting cookie named test4
Getting cookie named test4
 4:45.96 INFO Getting cookie named test5
Getting cookie named test5
 4:45.96 INFO Getting cookie named test6
Getting cookie named test6
 4:45.97 INFO Getting cookie named test7
Getting cookie named test7
 4:45.98 INFO Getting cookie named test8
Getting cookie named test8
 4:45.98 INFO Deleting all cookies
Deleting all cookies
TEST-PASS | /infrastructure/testdriver/get_named_cookie.sub.https.html | Get Named HTTPS cookie 
 4:45.99 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_named_cookie.sub.https.html | took 262ms
 4:45.99 TEST_START: /infrastructure/testdriver/send_keys.html
TEST-START | /infrastructure/testdriver/send_keys.html
 4:46.00 INFO Closing window c49cfedf-e95e-4c35-b713-53b07b36b02f
Closing window c49cfedf-e95e-4c35-b713-53b07b36b02f
TEST-PASS | /infrastructure/testdriver/send_keys.html | TestDriver send keys method 
 4:46.27 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/send_keys.html | took 278ms
 4:46.27 TEST_START: /infrastructure/testdriver/set_get_window_rect.html
TEST-START | /infrastructure/testdriver/set_get_window_rect.html
 4:46.27 INFO Closing window 1b6b03e2-d343-4e19-8677-491efa920be6
Closing window 1b6b03e2-d343-4e19-8677-491efa920be6
TEST-PASS | /infrastructure/testdriver/set_get_window_rect.html | Window Position 
TEST-PASS | /infrastructure/testdriver/set_get_window_rect.html | Window Size 
 4:46.49 TEST_END: Test OK. Subtests passed 2/2. Unexpected 0
TEST-OK | /infrastructure/testdriver/set_get_window_rect.html | took 223ms
 4:46.49 TEST_START: /infrastructure/testdriver/set_permission.https.html
TEST-START | /infrastructure/testdriver/set_permission.https.html
 4:46.49 INFO Closing window e76e6810-3381-4256-98a1-be0812a5b0d4
Closing window e76e6810-3381-4256-98a1-be0812a5b0d4
TEST-PASS | /infrastructure/testdriver/set_permission.https.html | Grant Permission 
TEST-PASS | /infrastructure/testdriver/set_permission.https.html | Deny Permission 
 4:46.73 TEST_END: Test OK. Subtests passed 2/2. Unexpected 0
TEST-OK | /infrastructure/testdriver/set_permission.https.html | took 235ms
 4:46.73 TEST_START: /infrastructure/testdriver/virtual_authenticator.html
TEST-START | /infrastructure/testdriver/virtual_authenticator.html
 4:46.73 INFO Closing window 43f4f0e4-b4b8-4f02-81d0-1e1922d0af51
Closing window 43f4f0e4-b4b8-4f02-81d0-1e1922d0af51
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can create an authenticator 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can add a credential 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can get the credentials 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can remove a credential 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can remove all credentials 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can set user verified 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can remove a virtual authenticator 
 4:47.01 TEST_END: Test OK. Subtests passed 7/7. Unexpected 0
TEST-OK | /infrastructure/testdriver/virtual_authenticator.html | took 285ms
 4:47.01 TEST_START: /infrastructure/testharness/full.stop/full-stop.html
TEST-START | /infrastructure/testharness/full.stop/full-stop.html
 4:47.01 INFO Closing window b81b039a-5822-4cc7-a7db-bbd352382f14
Closing window b81b039a-5822-4cc7-a7db-bbd352382f14
TEST-PASS | /infrastructure/testharness/full.stop/full-stop.html | full-stop 
 4:47.15 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testharness/full.stop/full-stop.html | took 135ms
 4:47.15 TEST_START: /infrastructure/testharness/lone-surrogates.html
TEST-START | /infrastructure/testharness/lone-surrogates.html
 4:47.15 INFO Closing window 3d5c4add-3424-4d95-b176-18aab5aa270f
Closing window 3d5c4add-3424-4d95-b176-18aab5aa270f
TEST-PASS | /infrastructure/testharness/lone-surrogates.html | passing test with lone surrogate U+d800 in name 
TEST-FAIL | /infrastructure/testharness/lone-surrogates.html | failing test with lone surrogate U+d800 in name - assert_true: expected true got false
@http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:7:25
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2869:25
test@http://web-platform.test:8000/resources/testharness.js:633:30
@http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:7:7
TEST-PASS | /infrastructure/testharness/lone-surrogates.html | passing test with lone surrogate in assert 
TEST-FAIL | /infrastructure/testharness/lone-surrogates.html | failing test with lone surrogate in assert - assert_true: lone U+d800 surrogate expected true got false
@http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:9:25
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2869:25
test@http://web-platform.test:8000/resources/testharness.js:633:30
@http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:9:7
 4:47.29 TEST_END: Test OK. Subtests passed 2/4. Unexpected 0
TEST-OK | /infrastructure/testharness/lone-surrogates.html | took 142ms
 4:47.29 TEST_START: /infrastructure/window/minimize-1.html
TEST-START | /infrastructure/window/minimize-1.html
 4:47.30 INFO Closing window 4a359ce2-081a-4ea1-9e2a-b8361578f598
Closing window 4a359ce2-081a-4ea1-9e2a-b8361578f598
TEST-PASS | /infrastructure/window/minimize-1.html | Minimize a window 
 4:48.54 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/window/minimize-1.html | took 1252ms
 4:48.54 TEST_START: /infrastructure/window/minimize-2.html
TEST-START | /infrastructure/window/minimize-2.html
 4:48.54 INFO Closing window 00048a0e-d6c4-4ec0-a6f9-0e269c9ebc41
Closing window 00048a0e-d6c4-4ec0-a6f9-0e269c9ebc41
TEST-PASS | /infrastructure/window/minimize-2.html | Use testdriver to check window is not minimized 
 4:48.92 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/window/minimize-2.html | took 376ms
 4:48.92 INFO No more tests
No more tests
 4:48.92 pid:17649 1766601831376	Marionette	INFO	Stopped listening on port 43747
PID 17649 | 1766601831376	Marionette	INFO	Stopped listening on port 43747
 4:49.59 INFO Browser exited with return code -15
Browser exited with return code -15
 4:49.47 INFO Closing logging queue
Closing logging queue
 4:49.47 INFO queue closed
queue closed
 4:49.60 SUITE_END

web-platform-test
~~~~~~~~~~~~~~~~~
Ran 411 checks (224 subtests, 187 tests)
Expected results: 409
Skipped: 2 tests
Unexpected results: 0
OK
SUITE-END | took 239s
 4:49.61 INFO Got 0 unexpected results, with 0 unexpected passes
Got 0 unexpected results, with 0 unexpected passes
 4:49.61 wptserve INFO Stopped http server on 127.0.0.1:8000
wptserve Stopped http server on 127.0.0.1:8000
 4:49.61 wptserve INFO Stopped http server on 127.0.0.1:8003
wptserve Stopped http server on 127.0.0.1:8003
 4:49.62 wptserve INFO Stopped http server on 127.0.0.1:8002
wptserve Stopped http server on 127.0.0.1:8002
 4:49.62 wptserve INFO Stopped http server on 127.0.0.1:8001
wptserve Stopped http server on 127.0.0.1:8001
 4:49.62 wptserve INFO Stopped http server on 127.0.0.1:8443
wptserve Stopped http server on 127.0.0.1:8443
 4:49.62 wptserve INFO Stopped http server on 127.0.0.1:8444
wptserve Stopped http server on 127.0.0.1:8444
 4:49.62 wptserve INFO Stopped http server on 127.0.0.1:8445
wptserve Stopped http server on 127.0.0.1:8445
 4:49.62 wptserve INFO Stopped http server on 127.0.0.1:8446
wptserve Stopped http server on 127.0.0.1:8446
 4:49.62 wptserve INFO Stopped http server on 127.0.0.1:9000
wptserve Stopped http server on 127.0.0.1:9000
 4:49.62 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
wptserve Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
 4:49.65 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 4:49.94 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 4:49.98 INFO Removed font: Ahem.ttf
Removed font: Ahem.ttf
 4:50.00 INFO Closing logging queue
Closing logging queue
 4:50.00 INFO queue closed
queue closed
[taskcluster 2025-12-24 18:43:53.703Z] === Task Finished ===
[taskcluster 2025-12-24 18:43:54.428Z] Successful task run with exit code: 0 completed in 516.714 seconds
View more details on Community-TC Integration