feat(runner): Integrate Test262 execution with wptrunner and add smoke tests [pt 3/5] #56842
Community-TC (pull_request)
Collect results for all tests affected by a pull request in firefox but without the changes in the PR.
Details
View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster
Task Status
Started: 2025-12-19T18:52:31.647Z
Resolved: 2025-12-19T18:56:37.172Z
Task Execution Time: 4 minutes, 5 seconds, 525 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0
Artifacts
- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md
- public/results/wpt_report.json.gz
- public/results/wpt_screenshot.txt.gz
WPT Command: python3 ./wpt run --channel=nightly --no-fail-on-unexpected --log-wptreport=../artifacts/wpt_report.json --log-wptscreenshot=../artifacts/wpt_screenshot.txt --affected task_head --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --verify-log-full --no-headless --binary=/home/test/build/firefox/firefox firefox
[taskcluster 2025-12-19 18:52:31.822Z] Task ID: dGyQRUqbTeG16OGG743y0w
[taskcluster 2025-12-19 18:52:31.822Z] Worker ID: 5240588277255778215
[taskcluster 2025-12-19 18:52:31.822Z] Worker Group: us-east1-d
[taskcluster 2025-12-19 18:52:31.822Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2025-12-19 18:52:31.822Z] Worker Pool: proj-wpt/ci
[taskcluster 2025-12-19 18:52:31.822Z] Worker Version: 46.1.0
[taskcluster 2025-12-19 18:52:31.822Z] Public IP: 34.138.38.11
[taskcluster 2025-12-19 18:52:31.822Z] Hostname: proj-wpt-ci-esx1e0r0q8i-vbw4f-7xbg
[taskcluster 2025-12-19 18:52:32.815Z] === Task Starting ===
+ '[' '' ']'
+ '[' -d /etc/profile.d ']'
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/01-locale-fix.sh ']'
+ . /etc/profile.d/01-locale-fix.sh
+++ /usr/bin/locale-check C.UTF-8
++ eval
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/apps-bin-path.sh ']'
+ . /etc/profile.d/apps-bin-path.sh
++ snap_bin_path=/snap/bin
++ '[' -n /home/test/bin:/home/test/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ']'
++ '[' -n /home/test/bin:/home/test/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ']'
++ export PATH=/home/test/bin:/home/test/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin
++ PATH=/home/test/bin:/home/test/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin
++ '[' -z '' ']'
++ export XDG_DATA_DIRS=/usr/local/share:/usr/share
++ XDG_DATA_DIRS=/usr/local/share:/usr/share
++ snap_xdg_path=/var/lib/snapd/desktop
++ '[' -n /usr/local/share:/usr/share ']'
++ '[' -n /usr/local/share:/usr/share ']'
++ export XDG_DATA_DIRS=/usr/local/share:/usr/share:/var/lib/snapd/desktop
++ XDG_DATA_DIRS=/usr/local/share:/usr/share:/var/lib/snapd/desktop
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/libvirt-uri.sh ']'
+ . /etc/profile.d/libvirt-uri.sh
++ LIBVIRT_DEFAULT_URI=qemu:///system
++ '[' -f /proc/xen/capabilities ']'
++ export LIBVIRT_DEFAULT_URI
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/vte-2.91.sh ']'
+ . /etc/profile.d/vte-2.91.sh
++ '[' -n '5.1.16(1)-release' -o -n '' ']'
++ [[ hxBc == *i* ]]
++ return 0
+ unset i
+ '[' -n '5.1.16(1)-release' ']'
+ '[' -f /home/test/.bashrc ']'
+ . /home/test/.bashrc
+ '[' -d /home/test/bin ']'
+ PATH=/home/test/bin:/home/test/bin:/home/test/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin
+ '[' -d /home/test/.local/bin ']'
+ /home/test/start.sh https://github.com/web-platform-tests/wpt.git refs/pull/56842/merge
+ REMOTE=https://github.com/web-platform-tests/wpt.git
+ REF=refs/pull/56842/merge
+ cd /home/test
+ '[' -e /dev/kvm ']'
+ '[' '!' -d web-platform-tests ']'
+ mkdir web-platform-tests
+ cd web-platform-tests
+ git init
hint: Using 'master' as the name for the initial branch. This default branch name
hint: is subject to change. To configure the initial branch name to use in all
hint: of your new repositories, which will suppress this warning, call:
hint:
hint: git config --global init.defaultBranch <name>
hint:
hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
hint: 'development'. The just-created branch can be renamed via this command:
hint:
hint: git branch -m <name>
Initialized empty Git repository in /home/test/web-platform-tests/.git/
+ git remote add origin https://github.com/web-platform-tests/wpt.git
+ retry git fetch --quiet --depth=50 --tags origin refs/pull/56842/merge:task_head
Running git fetch --quiet --depth=50 --tags origin refs/pull/56842/merge:task_head [try 1/5]
Command succeeded
+ git checkout --quiet task_head
+ cd web-platform-tests
+ ./tools/ci/run_tc.py --ref=refs/pull/56842/merge --head-rev=94dd56717fdbc4da5acd2bdfe4e7684642e19312 --merge-rev=0151a1ffc7b004f5ccc148a36e77a2a507f71ab7 --oom-killer --xvfb --hosts --checkout=base_head --browser=firefox --channel=nightly --install-certificates -- ./tools/ci/taskcluster-run.py --commit-range task_head firefox nightly -- --channel=nightly --no-fail-on-unexpected --log-wptreport=../artifacts/wpt_report.json --log-wptscreenshot=../artifacts/wpt_screenshot.txt
git rev-parse task_head
git rev-parse task_head^@
git branch base_head df146d59ea0d79a41df94ef455330637df8658b8
git branch pr_head 94dd56717fdbc4da5acd2bdfe4e7684642e19312
git fetch --quiet origin feat/test262-serve-handler:feat/test262-serve-handler
git checkout --quiet base_head
git for-each-ref refs/heads
INFO: git refs:
df146d59ea0d79a41df94ef455330637df8658b8 commit refs/heads/base_head
df146d59ea0d79a41df94ef455330637df8658b8 commit refs/heads/feat/test262-serve-handler
94dd56717fdbc4da5acd2bdfe4e7684642e19312 commit refs/heads/pr_head
0151a1ffc7b004f5ccc148a36e77a2a507f71ab7 commit refs/heads/task_head
git rev-parse HEAD
INFO: checked out commit:
df146d59ea0d79a41df94ef455330637df8658b8
DEBUG: Got artifacts {'artifacts': [{'storageType': 's3', 'name': 'public/logs/live_backing.log', 'expires': '2026-12-20T18:50:04.195Z', 'contentType': 'text/plain; charset=utf-8'}, {'storageType': 'link', 'name': 'public/logs/live.log', 'expires': '2026-12-20T18:50:04.195Z', 'contentType': 'text/plain; charset=utf-8'}, {'storageType': 's3', 'name': 'public/results/firefox-nightly.tar.xz', 'expires': '2026-12-20T18:50:04.195Z', 'contentType': 'application/x-xz'}]}
DEBUG: candidate: public/logs/live_backing.log glob: public/results/firefox-nightly.*
DEBUG: candidate: public/logs/live.log glob: public/results/firefox-nightly.*
DEBUG: candidate: public/results/firefox-nightly.tar.xz glob: public/results/firefox-nightly.*
INFO: Fetching aritfact public/results/firefox-nightly.tar.xz from task ZDw6QP2jRSCmxGWA0XScew
tar -xf /home/test/build/firefox-nightly.tar.xz
sudo sh -c ./wpt make-hosts-file >> /etc/hosts
sudo cp tools/certs/cacert.pem /usr/local/share/ca-certificates/cacert.crt
sudo update-ca-certificates
Updating certificates in /etc/ssl/certs...
rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL
1 added, 0 removed; done.
Running hooks in /etc/ca-certificates/update.d...
Adding debian:cacert.pem
done.
done.
sudo Xvfb :99.0 -screen 0 1280x1024x24
sudo fluxbox -display :99.0
sudo earlyoom -p -r 60 --prefer=(chrome|firefox) --avoid=python
./tools/ci/taskcluster-run.py --commit-range task_head firefox nightly -- --channel=nightly --no-fail-on-unexpected --log-wptreport=../artifacts/wpt_report.json --log-wptscreenshot=../artifacts/wpt_screenshot.txt
earlyoom v1.6.2
Preferring to kill process names that match regex '(chrome|firefox)'
Will avoid killing process names that match regex 'python'
Could not set priority: Permission denied. Continuing anyway
Could not set oom_score_adj: Permission denied. Continuing anyway
mem total: 15806 MiB, swap total: 0 MiB
sending SIGTERM when mem <= 10.00% and swap <= 10.00%,
SIGKILL when mem <= 5.00% and swap <= 5.00%
Could not lock memory - continuing anyway: Cannot allocate memory
mem avail: 15002 of 15806 MiB (94.92%), swap free: 0 of 0 MiB ( 0.00%)
INFO:manifest:Downloading manifest from https://github.com/web-platform-tests/wpt/releases/download/merge_pr_56830/MANIFEST-f390b46ed766db69705d87d248314e53a1f7aeeb.json.bz2
INFO:manifest:Manifest downloaded
2025-12-19 18:53:19,656 - tc-run - INFO - Running tests affected in range 'task_head'...
2025-12-19 18:53:19,657 - tc-run - INFO - Executing command: python3 ./wpt run --channel=nightly --no-fail-on-unexpected --log-wptreport=../artifacts/wpt_report.json --log-wptscreenshot=../artifacts/wpt_screenshot.txt --affected task_head --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --verify-log-full --no-headless --binary=/home/test/build/firefox/firefox firefox
INFO:tools.wpt.virtualenv:Creating new venv at '/home/test/web-platform-tests/_venv3'
mem avail: 14894 of 15806 MiB (94.23%), swap free: 0 of 0 MiB ( 0.00%)
0:00.00 INFO Set tests_root to /home/test/web-platform-tests
0:00.00 INFO Set metadata_root to /home/test/web-platform-tests
0:00.00 INFO Set manifest_update to True
0:00.00 INFO Set manifest_download to True
mem avail: 14890 of 15806 MiB (94.21%), swap free: 0 of 0 MiB ( 0.00%)
0:42.38 INFO Identified 0 affected tests
0:42.38 INFO Using certutil /usr/bin/certutil
0:42.38 INFO Downloading geckodriver
0:42.38 INFO Attempting to install webdriver from nightly
0:42.75 INFO Extracted geckodriver to /home/test/web-platform-tests/_venv3/bin/geckodriver
0:42.75 INFO Installed b'geckodriver 0.36.0 (7c6e6dc03dc0 2025-12-09 16:28 +0200)'
0:46.86 INFO Getting profile data from git ref c7464169c3c328e443619db9c6dad0e1e7545606
0:47.49 INFO Test prefs downloaded to /home/test/web-platform-tests/_venv3/profiles/c7464169c3c328e443619db9c6dad0e1e7545606/148.0a1
[1313] Sandbox: CanCreateUserNamespace() clone() failure: EPERM
0:47.61 mozversion INFO application_buildid: 20251219090705
0:47.61 mozversion INFO application_changeset: 304947ca16aad74c19866a59fbe75230129ca192
0:47.61 mozversion INFO application_display_name: Firefox Nightly
0:47.61 mozversion INFO application_id: {ec8030f7-c20a-464f-9b0e-13a3a9e97384}
0:47.61 mozversion INFO application_name: Firefox
0:47.61 mozversion INFO application_remotingname: firefox-nightly
0:47.61 mozversion INFO application_repository: https://hg.mozilla.org/mozilla-central
0:47.61 mozversion INFO application_vendor: Mozilla
0:47.61 mozversion INFO application_version: 148.0a1
0:47.61 mozversion INFO platform_buildid: 20251219090705
0:47.61 mozversion INFO platform_changeset: 304947ca16aad74c19866a59fbe75230129ca192
0:47.61 mozversion INFO platform_repository: https://hg.mozilla.org/mozilla-central
0:47.61 mozversion INFO platform_version: 148.0a1
0:53.21 INFO Installed font: Ahem.ttf
0:54.16 wptserve INFO Starting http server on http://127.0.0.1:8000
0:54.18 wptserve INFO Starting http server on http://127.0.0.1:8001
0:54.20 wptserve INFO Starting http server on http://127.0.0.1:8003
0:54.22 wptserve INFO Starting http server on http://127.0.0.1:8002
0:54.24 wptserve INFO Starting https server on https://127.0.0.1:8443
0:54.25 wptserve INFO Starting https server on https://127.0.0.1:8446
0:54.27 wptserve INFO Starting https server on https://127.0.0.1:8445
0:54.27 wptserve INFO Create socket on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
0:54.27 wptserve INFO Bind on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
0:54.27 wptserve INFO Listen on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
0:54.28 wptserve INFO Create socket on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
0:54.28 wptserve INFO Starting https server on https://127.0.0.1:8444
0:54.28 wptserve INFO Bind on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
0:54.28 wptserve INFO Listen on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
0:54.29 wptserve INFO Starting http2 server on https://127.0.0.1:9000
0:54.36 wptserve INFO Starting WebTransport over HTTP/3 server on 127.0.0.1:11000
0:54.62 SUITE_START: web-platform-test - running 0 tests
1:12.86 INFO Using 1 child processes
1:12.86 INFO No more tests
1:12.86 SUITE_END
web-platform-test
~~~~~~~~~~~~~~~~~
Ran 0 checks ()
Expected results: 0
Unexpected results: 0
OK
1:12.86 INFO Got 0 unexpected results, with 0 unexpected passes
1:12.86 wptserve INFO Stopped http server on 127.0.0.1:8000
1:12.86 wptserve INFO Stopped http server on 127.0.0.1:8001
1:12.86 wptserve INFO Stopped http server on 127.0.0.1:8002
1:12.88 wptserve INFO Stopped http server on 127.0.0.1:8003
1:12.89 wptserve INFO Stopped http server on 127.0.0.1:8443
1:12.89 wptserve INFO Stopped http server on 127.0.0.1:8445
1:12.89 wptserve INFO Stopped http server on 127.0.0.1:8444
1:12.89 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
1:12.89 wptserve INFO Stopped http server on 127.0.0.1:8446
1:12.89 wptserve INFO Stopped http server on 127.0.0.1:9000
1:13.14 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
1:13.14 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
1:13.29 INFO Removed font: Ahem.ttf
1:13.31 INFO Closing logging queue
1:13.32 INFO queue closed
1:13.32 INFO No tests ran
[taskcluster 2025-12-19 18:56:35.323Z] === Task Finished ===
[taskcluster 2025-12-19 18:56:36.355Z] Successful task run with exit code: 0 completed in 244.534 seconds