Skip to content

Update WAVE test runner #46286

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
FritzHeiden wants to merge 16 commits into
base: master
Choose a base branch
from

refactor: use property instead of index in urlsplit

132d4fb
Select commit
Loading
Failed to load commit list.
Open

Update WAVE test runner #46286

refactor: use property instead of index in urlsplit
132d4fb
Select commit
Loading
Failed to load commit list.
Community-TC Integration / infrastructure/ tests (firefox) succeeded Nov 11, 2025 in 8m 25s

Community-TC (pull_request)

Smoketests for wptrunner in firefox.

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2025-11-11T12:53:56.111Z
Resolved: 2025-11-11T13:00:39.469Z
Task Execution Time: 6 minutes, 43 seconds, 358 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md
- public/results/wptreport-firefox.json.gz

WPT Command: python3 ./wpt run --log-tbpl=- --log-wptreport=../artifacts/wptreport-firefox.json --logcat-dir=../artifacts/ --metadata=infrastructure/metadata/ --include=infrastructure/ --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --verify-log-full --no-headless --binary=/home/test/build/firefox/firefox firefox

[taskcluster 2025-11-11 12:53:56.204Z] Task ID: D-_-SQyBQlulG_kx_caITg
[taskcluster 2025-11-11 12:53:56.204Z] Worker ID: 5124063705683627638
[taskcluster 2025-11-11 12:53:56.204Z] Worker Group: us-east4-c
[taskcluster 2025-11-11 12:53:56.204Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2025-11-11 12:53:56.204Z] Worker Pool: proj-wpt/ci
[taskcluster 2025-11-11 12:53:56.204Z] Worker Version: 46.1.0
[taskcluster 2025-11-11 12:53:56.204Z] Public IP: 34.48.154.174
[taskcluster 2025-11-11 12:53:56.204Z] Hostname: proj-wpt-ci-kapukmierckn8hjt1t6uva

[taskcluster 2025-11-11 12:53:57.095Z] === Task Starting ===
+ '[' '' ']'
+ '[' -d /etc/profile.d ']'
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/01-locale-fix.sh ']'
+ . /etc/profile.d/01-locale-fix.sh
+++ /usr/bin/locale-check C.UTF-8
++ eval
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/apps-bin-path.sh ']'
+ . /etc/profile.d/apps-bin-path.sh

...(3884 lines hidden)...

PID 17153 | list@resource://services-settings/Database.sys.mjs:96:13
 3:45.67 pid:17153 console.warn: BackupService: "There was an error while trying to get the Document's directory" [Exception... "Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIProperties.get]"  nsresult: "0x80004005 (NS_ERROR_FAILURE)"  location: "JS frame :: resource:///modules/backup/BackupService.sys.mjs :: get docsDirFolderPath :: line 1140"  data: no]
PID 17153 | console.warn: BackupService: "There was an error while trying to get the Document's directory" [Exception... "Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIProperties.get]"  nsresult: "0x80004005 (NS_ERROR_FAILURE)"  location: "JS frame :: resource:///modules/backup/BackupService.sys.mjs :: get docsDirFolderPath :: line 1140"  data: no]
 3:45.79 TEST_START: /infrastructure/reftest/testdriver-iframe.sub.html
TEST-START | /infrastructure/reftest/testdriver-iframe.sub.html
 3:46.72 WARNING Unexpected viewport size for /infrastructure/reftest/testdriver-iframe.sub.html, (798, 598), expected (800, 600)
Unexpected viewport size for /infrastructure/reftest/testdriver-iframe.sub.html, (798, 598), expected (800, 600)
 3:46.79 WARNING Unexpected viewport size for /infrastructure/reftest/green.html, (798, 598), expected (800, 600)
Unexpected viewport size for /infrastructure/reftest/green.html, (798, 598), expected (800, 600)
 3:46.79 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/testdriver-iframe.sub.html | took 1002ms
 3:46.79 INFO Restarting browser for new test environment
Restarting browser for new test environment
 3:46.80 pid:17153 1762866005878	Marionette	INFO	Stopped listening on port 38113
PID 17153 | 1762866005878	Marionette	INFO	Stopped listening on port 38113
 3:47.47 INFO Browser exited with return code -15
Browser exited with return code -15
 3:47.35 INFO Closing logging queue
Closing logging queue
 3:47.35 INFO queue closed
queue closed
 3:47.48 INFO Application command: /home/test/build/firefox/firefox --marionette --remote-allow-system-access about:blank -profile /tmp/tmpjfchnebv
Application command: /home/test/build/firefox/firefox --marionette --remote-allow-system-access about:blank -profile /tmp/tmpjfchnebv
 3:47.49 INFO Starting runner
Starting runner
 3:47.49 pid:17500 Full command: /home/test/build/firefox/firefox --marionette --remote-allow-system-access about:blank
pid:17500 [17500] Sandbox: CanCreateUserNamespace() clone() failure: EPERM
PID 17500 | [17500] Sandbox: CanCreateUserNamespace() clone() failure: EPERM
 3:48.02 pid:17500 1762866007097	Marionette	INFO	Marionette enabled
PID 17500 | 1762866007097	Marionette	INFO	Marionette enabled
 3:48.13 pid:17500 1762866007209	Marionette	INFO	Listening on port 53581
PID 17500 | 1762866007209	Marionette	INFO	Listening on port 53581
 3:49.11 pid:17500 console.error: services.settings:
PID 17500 | console.error: services.settings:
 3:49.11 pid:17500   Message: EmptyDatabaseError: "main/nimbus-desktop-experiments" has not been synced yet
PID 17500 |   Message: EmptyDatabaseError: "main/nimbus-desktop-experiments" has not been synced yet
 3:49.11 pid:17500   Stack:
PID 17500 |   Stack:
 3:49.11 pid:17500     EmptyDatabaseError@resource://services-settings/Database.sys.mjs:19:5
PID 17500 |     EmptyDatabaseError@resource://services-settings/Database.sys.mjs:19:5
 3:49.11 pid:17500 list@resource://services-settings/Database.sys.mjs:96:13
PID 17500 | list@resource://services-settings/Database.sys.mjs:96:13
 3:49.28 pid:17500 console.warn: BackupService: "There was an error while trying to get the Document's directory" [Exception... "Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIProperties.get]"  nsresult: "0x80004005 (NS_ERROR_FAILURE)"  location: "JS frame :: resource:///modules/backup/BackupService.sys.mjs :: get docsDirFolderPath :: line 1140"  data: no]
PID 17500 | console.warn: BackupService: "There was an error while trying to get the Document's directory" [Exception... "Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIProperties.get]"  nsresult: "0x80004005 (NS_ERROR_FAILURE)"  location: "JS frame :: resource:///modules/backup/BackupService.sys.mjs :: get docsDirFolderPath :: line 1140"  data: no]
 3:49.38 TEST_START: /infrastructure/reftest/testdriver-in-ref.html
TEST-START | /infrastructure/reftest/testdriver-in-ref.html
 3:49.44 pid:17500 1762866008521	Marionette	INFO	Testing http://web-platform.test:8000/infrastructure/reftest/testdriver-in-ref.html == http://web-platform.test:8000/infrastructure/reftest/testdriver.html
PID 17500 | 1762866008521	Marionette	INFO	Testing http://web-platform.test:8000/infrastructure/reftest/testdriver-in-ref.html == http://web-platform.test:8000/infrastructure/reftest/testdriver.html
 3:49.68 pid:17500 1762866008761	Marionette	INFO	Emitted TestRendered event
PID 17500 | 1762866008761	Marionette	INFO	Emitted TestRendered event
mem avail: 14032 of 15806 MiB (88.78%), swap free:    0 of    0 MiB ( 0.00%)
 4:09.38 pid:17500 console.warn: BackupService: "There was an error while trying to get the Document's directory" [Exception... "Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIProperties.get]"  nsresult: "0x80004005 (NS_ERROR_FAILURE)"  location: "JS frame :: resource:///modules/backup/BackupService.sys.mjs :: get docsDirFolderPath :: line 1140"  data: no]
PID 17500 | console.warn: BackupService: "There was an error while trying to get the Document's directory" [Exception... "Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIProperties.get]"  nsresult: "0x80004005 (NS_ERROR_FAILURE)"  location: "JS frame :: resource:///modules/backup/BackupService.sys.mjs :: get docsDirFolderPath :: line 1140"  data: no]
 4:09.40 pid:17500 JavaScript error: resource:///modules/backup/BackupService.sys.mjs, line 3508: NotAllowedError: PathUtils.join: PathUtils does not support empty paths
PID 17500 | JavaScript error: resource:///modules/backup/BackupService.sys.mjs, line 3508: NotAllowedError: PathUtils.join: PathUtils does not support empty paths
 4:09.40 TEST_END: TIMEOUT
TEST-TIMEOUT | /infrastructure/reftest/testdriver-in-ref.html | took 20026ms
 4:09.40 INFO Restarting browser for new test environment
Restarting browser for new test environment
 4:09.41 pid:17500 1762866028494	Marionette	INFO	Stopped listening on port 53581
PID 17500 | 1762866028494	Marionette	INFO	Stopped listening on port 53581
 4:10.01 INFO Browser exited with return code -15
Browser exited with return code -15
 4:09.88 INFO Closing logging queue
Closing logging queue
 4:09.88 INFO queue closed
queue closed
 4:10.02 INFO Application command: /home/test/build/firefox/firefox --marionette --remote-allow-system-access about:blank -profile /tmp/tmpgng7vj1h
Application command: /home/test/build/firefox/firefox --marionette --remote-allow-system-access about:blank -profile /tmp/tmpgng7vj1h
 4:10.03 INFO Starting runner
Starting runner
 4:10.03 pid:17878 Full command: /home/test/build/firefox/firefox --marionette --remote-allow-system-access about:blank
pid:17878 [17878] Sandbox: CanCreateUserNamespace() clone() failure: EPERM
PID 17878 | [17878] Sandbox: CanCreateUserNamespace() clone() failure: EPERM
 4:10.56 pid:17878 1762866029645	Marionette	INFO	Marionette enabled
PID 17878 | 1762866029645	Marionette	INFO	Marionette enabled
 4:10.67 pid:17878 1762866029755	Marionette	INFO	Listening on port 40579
PID 17878 | 1762866029755	Marionette	INFO	Listening on port 40579
 4:10.68 pid:17878 [Parent 17878, Main Thread] WARNING: Failed to create DBus proxy for org.a11y.Bus: Could not connect: Connection refused
PID 17878 | [Parent 17878, Main Thread] WARNING: Failed to create DBus proxy for org.a11y.Bus: Could not connect: Connection refused
 4:10.68 pid:17878 : 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:201
PID 17878 | : 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:201
 4:10.68 pid:17878 ** (firefox-nightly:17878): WARNING **: 13:00:29.762: Failed to create DBus proxy for org.a11y.Bus: Could not connect: Connection refused
PID 17878 | ** (firefox-nightly:17878): WARNING **: 13:00:29.762: Failed to create DBus proxy for org.a11y.Bus: Could not connect: Connection refused
 4:11.67 pid:17878 console.error: services.settings:
PID 17878 | console.error: services.settings:
 4:11.68 pid:17878   Message: EmptyDatabaseError: "main/nimbus-desktop-experiments" has not been synced yet
PID 17878 |   Message: EmptyDatabaseError: "main/nimbus-desktop-experiments" has not been synced yet
 4:11.68 pid:17878   Stack:
PID 17878 |   Stack:
 4:11.68 pid:17878     EmptyDatabaseError@resource://services-settings/Database.sys.mjs:19:5
PID 17878 |     EmptyDatabaseError@resource://services-settings/Database.sys.mjs:19:5
 4:11.68 pid:17878 list@resource://services-settings/Database.sys.mjs:96:13
PID 17878 | list@resource://services-settings/Database.sys.mjs:96:13
 4:11.83 pid:17878 console.warn: BackupService: "There was an error while trying to get the Document's directory" [Exception... "Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIProperties.get]"  nsresult: "0x80004005 (NS_ERROR_FAILURE)"  location: "JS frame :: resource:///modules/backup/BackupService.sys.mjs :: get docsDirFolderPath :: line 1140"  data: no]
PID 17878 | console.warn: BackupService: "There was an error while trying to get the Document's directory" [Exception... "Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIProperties.get]"  nsresult: "0x80004005 (NS_ERROR_FAILURE)"  location: "JS frame :: resource:///modules/backup/BackupService.sys.mjs :: get docsDirFolderPath :: line 1140"  data: no]
 4:11.92 TEST_START: /infrastructure/reftest/testdriver.html
TEST-START | /infrastructure/reftest/testdriver.html
 4:12.79 WARNING Unexpected viewport size for /infrastructure/reftest/testdriver.html, (798, 598), expected (800, 600)
Unexpected viewport size for /infrastructure/reftest/testdriver.html, (798, 598), expected (800, 600)
 4:12.79 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/testdriver.html | took 865ms
 4:12.79 INFO Restarting browser for new test environment
Restarting browser for new test environment
 4:12.81 pid:17878 1762866031886	Marionette	INFO	Stopped listening on port 40579
PID 17878 | 1762866031886	Marionette	INFO	Stopped listening on port 40579
 4:13.51 INFO Browser exited with return code -15
Browser exited with return code -15
 4:13.39 INFO Closing logging queue
Closing logging queue
 4:13.39 INFO queue closed
queue closed
 4:13.52 INFO Application command: /home/test/build/firefox/firefox --marionette --remote-allow-system-access about:blank -profile /tmp/tmpzwigadvl
Application command: /home/test/build/firefox/firefox --marionette --remote-allow-system-access about:blank -profile /tmp/tmpzwigadvl
 4:13.53 INFO Starting runner
Starting runner
 4:13.53 pid:18223 Full command: /home/test/build/firefox/firefox --marionette --remote-allow-system-access about:blank
pid:18223 [18223] Sandbox: CanCreateUserNamespace() clone() failure: EPERM
PID 18223 | [18223] Sandbox: CanCreateUserNamespace() clone() failure: EPERM
 4:14.10 pid:18223 1762866033182	Marionette	INFO	Marionette enabled
PID 18223 | 1762866033182	Marionette	INFO	Marionette enabled
 4:14.22 pid:18223 1762866033295	Marionette	INFO	Listening on port 37027
PID 18223 | 1762866033295	Marionette	INFO	Listening on port 37027
 4:15.24 pid:18223 console.error: services.settings:
PID 18223 | console.error: services.settings:
 4:15.24 pid:18223   Message: EmptyDatabaseError: "main/nimbus-desktop-experiments" has not been synced yet
PID 18223 |   Message: EmptyDatabaseError: "main/nimbus-desktop-experiments" has not been synced yet
 4:15.24 pid:18223   Stack:
PID 18223 |   Stack:
 4:15.25 pid:18223     EmptyDatabaseError@resource://services-settings/Database.sys.mjs:19:5
PID 18223 |     EmptyDatabaseError@resource://services-settings/Database.sys.mjs:19:5
 4:15.25 pid:18223 list@resource://services-settings/Database.sys.mjs:96:13
PID 18223 | list@resource://services-settings/Database.sys.mjs:96:13
 4:15.36 pid:18223 console.warn: BackupService: "There was an error while trying to get the Document's directory" [Exception... "Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIProperties.get]"  nsresult: "0x80004005 (NS_ERROR_FAILURE)"  location: "JS frame :: resource:///modules/backup/BackupService.sys.mjs :: get docsDirFolderPath :: line 1140"  data: no]
PID 18223 | console.warn: BackupService: "There was an error while trying to get the Document's directory" [Exception... "Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIProperties.get]"  nsresult: "0x80004005 (NS_ERROR_FAILURE)"  location: "JS frame :: resource:///modules/backup/BackupService.sys.mjs :: get docsDirFolderPath :: line 1140"  data: no]
 4:15.47 TEST_START: /infrastructure/reftest-wait.html
TEST-START | /infrastructure/reftest-wait.html
 4:15.50 pid:18223 1762866034586	Marionette	INFO	Testing http://web-platform.test:8000/infrastructure/reftest-wait.html == http://web-platform.test:8000/infrastructure/reftest-wait-ref.html
PID 18223 | 1762866034586	Marionette	INFO	Testing http://web-platform.test:8000/infrastructure/reftest-wait.html == http://web-platform.test:8000/infrastructure/reftest-wait-ref.html
 4:15.77 pid:18223 1762866034853	Marionette	INFO	Emitted TestRendered event
PID 18223 | 1762866034853	Marionette	INFO	Emitted TestRendered event
 4:16.75 pid:18223 1762866035835	Marionette	INFO	No differences allowed
PID 18223 | 1762866035835	Marionette	INFO	No differences allowed
 4:16.76 TEST_END: PASS
TEST-PASS | /infrastructure/reftest-wait.html | took 1282ms
 4:16.76 INFO No more tests
No more tests
 4:16.79 pid:18223 1762866035868	Marionette	INFO	Stopped listening on port 37027
PID 18223 | 1762866035868	Marionette	INFO	Stopped listening on port 37027
 4:17.40 INFO Browser exited with return code -15
Browser exited with return code -15
 4:17.27 INFO Closing logging queue
Closing logging queue
 4:17.27 INFO queue closed
queue closed
 4:17.40 SUITE_END

web-platform-test
~~~~~~~~~~~~~~~~~
Ran 408 checks (223 subtests, 185 tests)
Expected results: 406
Skipped: 2 tests
Unexpected results: 0
OK
SUITE-END | took 238s
 4:17.40 INFO Got 0 unexpected results, with 0 unexpected passes
Got 0 unexpected results, with 0 unexpected passes
 4:17.41 wptserve INFO Stopped http server on 127.0.0.1:8000
wptserve Stopped http server on 127.0.0.1:8000
 4:17.41 wptserve INFO Stopped http server on 127.0.0.1:8001
wptserve Stopped http server on 127.0.0.1:8001
 4:17.41 wptserve INFO Stopped http server on 127.0.0.1:8002
wptserve Stopped http server on 127.0.0.1:8002
 4:17.42 wptserve INFO Stopped http server on 127.0.0.1:8003
wptserve Stopped http server on 127.0.0.1:8003
 4:17.42 wptserve INFO Stopped http server on 127.0.0.1:8443
wptserve Stopped http server on 127.0.0.1:8443
 4:17.43 wptserve INFO Stopped http server on 127.0.0.1:8444
wptserve Stopped http server on 127.0.0.1:8444
 4:17.43 wptserve INFO Stopped http server on 127.0.0.1:8446
wptserve Stopped http server on 127.0.0.1:8446
 4:17.44 wptserve INFO Stopped http server on 127.0.0.1:8445
wptserve Stopped http server on 127.0.0.1:8445
 4:17.44 wptserve INFO Stopped http server on 127.0.0.1:9000
wptserve Stopped http server on 127.0.0.1:9000
 4:17.44 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
wptserve Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
 4:17.50 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 4:17.70 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 4:17.74 INFO Removed font: Ahem.ttf
Removed font: Ahem.ttf
 4:17.77 INFO Closing logging queue
Closing logging queue
 4:17.77 INFO queue closed
queue closed
[taskcluster 2025-11-11 13:00:38.105Z] === Task Finished ===
[taskcluster 2025-11-11 13:00:38.732Z] Successful task run with exit code: 0 completed in 402.529 seconds
View more details on Community-TC Integration