Skip to content

WIP: Test262 support #55997

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
o- wants to merge 26 commits into
base: master
Choose a base branch
from

add missing newlines

765b4c2
Select commit
Loading
Failed to load commit list.
Draft

WIP: Test262 support #55997

add missing newlines
765b4c2
Select commit
Loading
Failed to load commit list.
Community-TC Integration / infrastructure/ tests (firefox) succeeded Dec 18, 2025 in 38m 50s

Community-TC (pull_request)

Smoketests for wptrunner in firefox.

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2025-12-18T01:50:37.673Z
Resolved: 2025-12-18T01:56:13.243Z
Task Execution Time: 5 minutes, 35 seconds, 570 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md
- public/results/wptreport-firefox.json.gz

WPT Command: python3 ./wpt run --log-tbpl=- --log-wptreport=../artifacts/wptreport-firefox.json --logcat-dir=../artifacts/ --metadata=infrastructure/metadata/ --include=infrastructure/ --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --verify-log-full --no-headless --binary=/home/test/build/firefox/firefox firefox

[taskcluster 2025-12-18 01:50:37.733Z] Task ID: LwtxYGuCTm6AFrejajb2QQ
[taskcluster 2025-12-18 01:50:37.733Z] Worker ID: 7581072405325343594
[taskcluster 2025-12-18 01:50:37.733Z] Worker Group: us-east4-c
[taskcluster 2025-12-18 01:50:37.733Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2025-12-18 01:50:37.733Z] Worker Pool: proj-wpt/ci
[taskcluster 2025-12-18 01:50:37.733Z] Worker Version: 46.1.0
[taskcluster 2025-12-18 01:50:37.733Z] Public IP: 35.245.201.67
[taskcluster 2025-12-18 01:50:37.733Z] Hostname: proj-wpt-ci-ab-8qugntbecpfojr8cq0a

[taskcluster 2025-12-18 01:50:38.681Z] === Task Starting ===
+ '[' '' ']'
+ '[' -d /etc/profile.d ']'
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/01-locale-fix.sh ']'
+ . /etc/profile.d/01-locale-fix.sh
+++ /usr/bin/locale-check C.UTF-8
++ eval
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/apps-bin-path.sh ']'
+ . /etc/profile.d/apps-bin-path.sh

...(4125 lines hidden)...

PID 19852 | 1766022952505	Marionette	INFO	Testing http://web-platform.test:8000/infrastructure/reftest/reftest_match_fail-print.html == http://web-platform.test:8000/infrastructure/reftest/reftest_match-print-ref.html
 4:02.03 pid:19852 1766022954875	Marionette	INFO	Rendering page 1/2
PID 19852 | 1766022954875	Marionette	INFO	Rendering page 1/2
 4:02.04 pid:19852 1766022954891	Marionette	INFO	Rendering page 1/2
PID 19852 | 1766022954891	Marionette	INFO	Rendering page 1/2
 4:02.08 pid:19852 1766022954925	Marionette	INFO	No differences allowed
PID 19852 | 1766022954925	Marionette	INFO	No differences allowed
 4:02.08 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_fail-print.html | took 2424ms
 4:02.08 TEST_START: /infrastructure/reftest/reftest_mismatch-num-pages-print.html
TEST-START | /infrastructure/reftest/reftest_mismatch-num-pages-print.html
 4:02.08 pid:19852 1766022954929	Marionette	INFO	Testing http://web-platform.test:8000/infrastructure/reftest/reftest_mismatch-num-pages-print.html != http://web-platform.test:8000/infrastructure/reftest/reftest_match-print-ref.html
PID 19852 | 1766022954929	Marionette	INFO	Testing http://web-platform.test:8000/infrastructure/reftest/reftest_mismatch-num-pages-print.html != http://web-platform.test:8000/infrastructure/reftest/reftest_match-print-ref.html
 4:03.41 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_mismatch-num-pages-print.html | took 1326ms
 4:03.41 TEST_START: /infrastructure/reftest/reftest_mismatch-print.html
TEST-START | /infrastructure/reftest/reftest_mismatch-print.html
 4:03.41 pid:19852 1766022956256	Marionette	INFO	Testing http://web-platform.test:8000/infrastructure/reftest/reftest_mismatch-print.html != http://web-platform.test:8000/infrastructure/reftest/reftest_match-print-ref.html
PID 19852 | 1766022956256	Marionette	INFO	Testing http://web-platform.test:8000/infrastructure/reftest/reftest_mismatch-print.html != http://web-platform.test:8000/infrastructure/reftest/reftest_match-print-ref.html
 4:05.78 pid:19852 1766022958630	Marionette	INFO	Rendering page 1/2
PID 19852 | 1766022958630	Marionette	INFO	Rendering page 1/2
 4:05.81 pid:19852 1766022958662	Marionette	INFO	Rendering page 1/2
PID 19852 | 1766022958662	Marionette	INFO	Rendering page 1/2
 4:05.83 pid:19852 1766022958678	Marionette	INFO	No differences allowed
PID 19852 | 1766022958678	Marionette	INFO	No differences allowed
 4:05.83 pid:19852 1766022958678	Marionette	INFO	Rendering page 2/2
PID 19852 | 1766022958678	Marionette	INFO	Rendering page 2/2
 4:05.85 pid:19852 1766022958695	Marionette	INFO	Rendering page 2/2
PID 19852 | 1766022958695	Marionette	INFO	Rendering page 2/2
 4:05.86 pid:19852 1766022958712	Marionette	INFO	No differences allowed
PID 19852 | 1766022958712	Marionette	INFO	No differences allowed
 4:05.87 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_mismatch-print.html | took 2458ms
 4:05.87 TEST_START: /infrastructure/reftest/reftest_mismatch_fail-print.html
TEST-START | /infrastructure/reftest/reftest_mismatch_fail-print.html
 4:05.87 pid:19852 1766022958715	Marionette	INFO	Testing http://web-platform.test:8000/infrastructure/reftest/reftest_mismatch_fail-print.html != http://web-platform.test:8000/infrastructure/reftest/reftest_match-print-ref.html
PID 19852 | 1766022958715	Marionette	INFO	Testing http://web-platform.test:8000/infrastructure/reftest/reftest_mismatch_fail-print.html != http://web-platform.test:8000/infrastructure/reftest/reftest_match-print-ref.html
 4:08.19 pid:19852 1766022961042	Marionette	INFO	Rendering page 1/2
PID 19852 | 1766022961042	Marionette	INFO	Rendering page 1/2
 4:08.22 pid:19852 1766022961072	Marionette	INFO	Rendering page 1/2
PID 19852 | 1766022961072	Marionette	INFO	Rendering page 1/2
 4:08.26 pid:19852 1766022961104	Marionette	INFO	No differences allowed
PID 19852 | 1766022961104	Marionette	INFO	No differences allowed
 4:08.26 pid:19852 1766022961105	Marionette	INFO	Rendering page 2/2
PID 19852 | 1766022961105	Marionette	INFO	Rendering page 2/2
 4:08.27 pid:19852 1766022961121	Marionette	INFO	Rendering page 2/2
PID 19852 | 1766022961121	Marionette	INFO	Rendering page 2/2
 4:08.29 pid:19852 1766022961138	Marionette	INFO	No differences allowed
PID 19852 | 1766022961138	Marionette	INFO	No differences allowed
 4:08.29 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_mismatch_fail-print.html | took 2426ms
 4:08.29 TEST_START: /infrastructure/reftest/reftest_mismatch_page_margins-print.html
TEST-START | /infrastructure/reftest/reftest_mismatch_page_margins-print.html
 4:08.29 pid:19852 1766022961141	Marionette	INFO	Testing http://web-platform.test:8000/infrastructure/reftest/reftest_mismatch_page_margins-print.html != http://web-platform.test:8000/infrastructure/reftest/reftest_match-print-ref.html
PID 19852 | 1766022961141	Marionette	INFO	Testing http://web-platform.test:8000/infrastructure/reftest/reftest_mismatch_page_margins-print.html != http://web-platform.test:8000/infrastructure/reftest/reftest_match-print-ref.html
 4:10.62 pid:19852 1766022963464	Marionette	INFO	Rendering page 1/2
PID 19852 | 1766022963464	Marionette	INFO	Rendering page 1/2
 4:10.65 pid:19852 1766022963497	Marionette	INFO	Rendering page 1/2
PID 19852 | 1766022963497	Marionette	INFO	Rendering page 1/2
 4:10.68 pid:19852 1766022963530	Marionette	INFO	No differences allowed
PID 19852 | 1766022963530	Marionette	INFO	No differences allowed
 4:10.69 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_mismatch_page_margins-print.html | took 2393ms
 4:10.69 TEST_START: /infrastructure/reftest/reftest_wait_0-print.html
TEST-START | /infrastructure/reftest/reftest_wait_0-print.html
 4:10.69 pid:19852 1766022963534	Marionette	INFO	Testing http://web-platform.test:8000/infrastructure/reftest/reftest_wait_0-print.html == http://web-platform.test:8000/infrastructure/reftest/green.html
PID 19852 | 1766022963534	Marionette	INFO	Testing http://web-platform.test:8000/infrastructure/reftest/reftest_wait_0-print.html == http://web-platform.test:8000/infrastructure/reftest/green.html
 4:10.90 pid:19852 1766022963750	Marionette	INFO	Emitted TestRendered event
PID 19852 | 1766022963750	Marionette	INFO	Emitted TestRendered event
 4:12.99 pid:19852 1766022965833	Marionette	INFO	Rendering page 1/1
PID 19852 | 1766022965833	Marionette	INFO	Rendering page 1/1
 4:12.99 pid:19852 1766022965839	Marionette	INFO	Rendering page 1/1
PID 19852 | 1766022965839	Marionette	INFO	Rendering page 1/1
 4:13.01 pid:19852 1766022965856	Marionette	INFO	No differences allowed
PID 19852 | 1766022965856	Marionette	INFO	No differences allowed
 4:13.01 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_wait_0-print.html | took 2324ms
 4:13.01 INFO Restarting browser for new test group
Restarting browser for new test group
 4:13.03 pid:19852 1766022965881	Marionette	INFO	Stopped listening on port 49323
PID 19852 | 1766022965881	Marionette	INFO	Stopped listening on port 49323
 4:13.68 INFO Browser exited with return code -15
Browser exited with return code -15
 4:13.55 INFO Closing logging queue
Closing logging queue
 4:13.56 INFO queue closed
queue closed
 4:13.70 INFO Setting up ssl
Setting up ssl
 4:13.71 certutil b''
certutil | b''
 4:13.73 certutil b''
certutil | b''
 4:13.73 certutil b'\nCertificate Nickname                                         Trust Attributes\n                                                             SSL,S/MIME,JAR/XPI\n\nweb-platform-tests                                           CT,, \n'
certutil | b'\nCertificate Nickname                                         Trust Attributes\n                                                             SSL,S/MIME,JAR/XPI\n\nweb-platform-tests                                           CT,, \n'
 4:13.73 INFO Starting WebDriver: /home/test/web-platform-tests/_venv3/bin/geckodriver --host 127.0.0.1 --port 0 --binary /home/test/build/firefox/firefox
Starting WebDriver: /home/test/web-platform-tests/_venv3/bin/geckodriver --host 127.0.0.1 --port 0 --binary /home/test/build/firefox/firefox
 4:13.84 pid:20264 Full command: /home/test/web-platform-tests/_venv3/bin/geckodriver --host 127.0.0.1 --port 0 --binary /home/test/build/firefox/firefox
pid:20264 1766022966586	geckodriver	INFO	Listening on 127.0.0.1:36277
PID 20264 | 1766022966586	geckodriver	INFO	Listening on 127.0.0.1:36277
 4:13.84 INFO Webdriver started successfully.
Webdriver started successfully.
 4:13.84 INFO Starting runner
Starting runner
 4:14.14 TEST_START: /infrastructure/webdriver/tests/test_load_file.py
TEST-START | /infrastructure/webdriver/tests/test_load_file.py
 4:14.55 INFO STDOUT: ============================= test session starts ==============================
STDOUT: ============================= test session starts ==============================
 4:14.55 INFO STDOUT: platform linux -- Python 3.10.12, pytest-8.2.1, pluggy-unknown -- /usr/bin/python3
STDOUT: platform linux -- Python 3.10.12, pytest-8.2.1, pluggy-unknown -- /usr/bin/python3
 4:14.55 INFO STDOUT: rootdir: /home/test/web-platform-tests
STDOUT: rootdir: /home/test/web-platform-tests
 4:14.55 INFO STDOUT: plugins: asyncio-0.19.0
STDOUT: plugins: asyncio-0.19.0
 4:14.55 INFO STDOUT: asyncio: mode=strict
STDOUT: asyncio: mode=strict
 4:14.55 INFO STDOUT: collecting ... 
STDOUT: collecting ... 
 4:14.60 INFO STDOUT: collected 1 item
STDOUT: collected 1 item
 4:14.60 INFO STDOUT: infrastructure/webdriver/tests/test_load_file.py::test_load 
STDOUT: infrastructure/webdriver/tests/test_load_file.py::test_load 
 4:14.61 pid:20264 1766022967457	mozrunner::runner	INFO	Running command: MOZ_CRASHREPORTER="1" MOZ_CRASHREPORTER_NO_REPORT="1" MOZ_CRASHREPORTER_SHUTDOWN="1" "/home/test/build/firefox/firefox" "--marionette" "--profile" "/tmp/tmphu4a19ma.mozrunner" "-no-remote"
PID 20264 | 1766022967457	mozrunner::runner	INFO	Running command: MOZ_CRASHREPORTER="1" MOZ_CRASHREPORTER_NO_REPORT="1" MOZ_CRASHREPORTER_SHUTDOWN="1" "/home/test/build/firefox/firefox" "--marionette" "--profile" "/tmp/tmphu4a19ma.mozrunner" "-no-remote"
 4:14.61 pid:20264 [20281] Sandbox: CanCreateUserNamespace() clone() failure: EPERM
PID 20264 | [20281] Sandbox: CanCreateUserNamespace() clone() failure: EPERM
 4:15.06 pid:20264 1766022967908	Marionette	INFO	Marionette enabled
PID 20264 | 1766022967908	Marionette	INFO	Marionette enabled
 4:15.16 pid:20264 1766022968012	Marionette	INFO	Listening on port 43301
PID 20264 | 1766022968012	Marionette	INFO	Listening on port 43301
 4:15.17 pid:20264 [Parent 20281, Main Thread] WARNING: Failed to create DBus proxy for org.a11y.Bus: Could not connect: Connection refused
PID 20264 | [Parent 20281, Main Thread] WARNING: Failed to create DBus proxy for org.a11y.Bus: Could not connect: Connection refused
 4:15.17 pid:20264 : 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:201
PID 20264 | : 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:201
 4:15.17 pid:20264 ** (firefox-nightly:20281): WARNING **: 01:56:08.019: Failed to create DBus proxy for org.a11y.Bus: Could not connect: Connection refused
PID 20264 | ** (firefox-nightly:20281): WARNING **: 01:56:08.019: Failed to create DBus proxy for org.a11y.Bus: Could not connect: Connection refused
 4:15.21 pid:20264 Read port: 43301
PID 20264 | Read port: 43301
 4:16.24 pid:20264 console.warn: BackupService: "There was an error while trying to get the Document's directory" [Exception... "Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIProperties.get]"  nsresult: "0x80004005 (NS_ERROR_FAILURE)"  location: "JS frame :: resource:///modules/backup/BackupService.sys.mjs :: get docsDirFolderPath :: line 1225"  data: no]
PID 20264 | console.warn: BackupService: "There was an error while trying to get the Document's directory" [Exception... "Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIProperties.get]"  nsresult: "0x80004005 (NS_ERROR_FAILURE)"  location: "JS frame :: resource:///modules/backup/BackupService.sys.mjs :: get docsDirFolderPath :: line 1225"  data: no]
 4:16.63 INFO STDOUT: PASSED
STDOUT: PASSED
 4:16.65 pid:20264 1766022969501	Marionette	INFO	Stopped listening on port 43301
PID 20264 | 1766022969501	Marionette	INFO	Stopped listening on port 43301
 4:17.32 INFO STDOUT: ============================== 1 passed in 2.77s ===============================
STDOUT: ============================== 1 passed in 2.77s ===============================
TEST-PASS | /infrastructure/webdriver/tests/test_load_file.py | test_load 
 4:17.32 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/webdriver/tests/test_load_file.py | took 3180ms
 4:17.32 INFO No more tests
No more tests
 4:17.32 INFO Closing logging queue
Closing logging queue
 4:17.32 INFO queue closed
queue closed
 4:17.39 SUITE_END

web-platform-test
~~~~~~~~~~~~~~~~~
Ran 437 checks (237 subtests, 200 tests)
Expected results: 435
Skipped: 2 tests
Unexpected results: 0
OK
SUITE-END | took 239s
 4:17.39 INFO Got 0 unexpected results, with 0 unexpected passes
Got 0 unexpected results, with 0 unexpected passes
 4:17.40 wptserve INFO Stopped http server on 127.0.0.1:8000
wptserve Stopped http server on 127.0.0.1:8000
 4:17.40 wptserve INFO Stopped http server on 127.0.0.1:8001
wptserve Stopped http server on 127.0.0.1:8001
 4:17.41 wptserve INFO Stopped http server on 127.0.0.1:8444
wptserve Stopped http server on 127.0.0.1:8444
 4:17.41 wptserve INFO Stopped http server on 127.0.0.1:8445
wptserve Stopped http server on 127.0.0.1:8445
 4:17.41 wptserve INFO Stopped http server on 127.0.0.1:8003
wptserve Stopped http server on 127.0.0.1:8003
 4:17.41 wptserve INFO Stopped http server on 127.0.0.1:8002
wptserve Stopped http server on 127.0.0.1:8002
 4:17.41 wptserve INFO Stopped http server on 127.0.0.1:8443
wptserve Stopped http server on 127.0.0.1:8443
 4:17.41 wptserve INFO Stopped http server on 127.0.0.1:8446
wptserve Stopped http server on 127.0.0.1:8446
 4:17.41 wptserve INFO Stopped http server on 127.0.0.1:9000
wptserve Stopped http server on 127.0.0.1:9000
 4:17.41 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
wptserve Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
 4:17.42 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 4:17.62 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 4:17.66 INFO Removed font: Ahem.ttf
Removed font: Ahem.ttf
 4:17.68 INFO Closing logging queue
Closing logging queue
 4:17.68 INFO queue closed
queue closed
[taskcluster 2025-12-18 01:56:11.784Z] === Task Finished ===
[taskcluster 2025-12-18 01:56:12.449Z] Successful task run with exit code: 0 completed in 334.717 seconds
View more details on Community-TC Integration