Skip to content

WIP: Test262 support #55997

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
o- wants to merge 26 commits into
base: master
Choose a base branch
from

add missing newlines

765b4c2
Select commit
Loading
Failed to load commit list.
Draft

WIP: Test262 support #55997

add missing newlines
765b4c2
Select commit
Loading
Failed to load commit list.
Community-TC Integration / infrastructure/ tests (firefox_android) succeeded Dec 18, 2025 in 27m 15s

Community-TC (pull_request)

Smoketests for wptrunner in firefox_android.

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2025-12-18T01:27:12.061Z
Resolved: 2025-12-18T01:44:38.010Z
Task Execution Time: 17 minutes, 25 seconds, 949 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md
- public/results/emulator.log
- public/results/logcat-emulator-5554.log
- public/results/wptreport-firefox_android.json.gz

WPT Command: python3 ./wpt run --log-tbpl=- --log-wptreport=../artifacts/wptreport-firefox_android.json --logcat-dir=../artifacts/ --metadata=infrastructure/metadata/ --include=infrastructure/ --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --verify-log-full --no-headless --install-browser --install-webdriver --logcat-dir /home/test/artifacts/ firefox_android

[taskcluster 2025-12-18 01:27:12.131Z] Task ID: EG7ws3wFS7Srf8B9h3FavA
[taskcluster 2025-12-18 01:27:12.131Z] Worker ID: 6050891977144069469
[taskcluster 2025-12-18 01:27:12.131Z] Worker Group: us-east1-d
[taskcluster 2025-12-18 01:27:12.131Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2025-12-18 01:27:12.131Z] Worker Pool: proj-wpt/ci
[taskcluster 2025-12-18 01:27:12.131Z] Worker Version: 46.1.0
[taskcluster 2025-12-18 01:27:12.131Z] Public IP: 35.231.251.246
[taskcluster 2025-12-18 01:27:12.131Z] Hostname: proj-wpt-ci-rqvyfxsiqwssfx7erwbujw

[taskcluster 2025-12-18 01:27:13.105Z] === Task Starting ===
+ '[' '' ']'
+ '[' -d /etc/profile.d ']'
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/01-locale-fix.sh ']'
+ . /etc/profile.d/01-locale-fix.sh
+++ /usr/bin/locale-check C.UTF-8
++ eval
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/apps-bin-path.sh ']'
+ . /etc/profile.d/apps-bin-path.sh

...(4181 lines hidden)...

TEST-PASS | /infrastructure/testdriver/get_all_cookies.sub.html | Get all HTTP cookies 
15:43.59 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_all_cookies.sub.html | took 560ms
15:43.59 TEST_START: /infrastructure/testdriver/get_all_cookies.sub.https.html
TEST-START | /infrastructure/testdriver/get_all_cookies.sub.https.html
15:43.61 INFO Closing window 13083b42-0a5f-4f98-9989-f5497b92d505
Closing window 13083b42-0a5f-4f98-9989-f5497b92d505
15:44.52 INFO Getting all cookies
Getting all cookies
15:44.57 INFO Deleting all cookies
Deleting all cookies
TEST-PASS | /infrastructure/testdriver/get_all_cookies.sub.https.html | Get all HTTPS cookies 
15:44.67 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_all_cookies.sub.https.html | took 1077ms
15:44.67 TEST_START: /infrastructure/testdriver/get_named_cookie.sub.html
TEST-START | /infrastructure/testdriver/get_named_cookie.sub.html
15:44.67 INFO Closing window 936f5f95-b498-4d2b-b674-5b339ca7f9c2
Closing window 936f5f95-b498-4d2b-b674-5b339ca7f9c2
15:45.61 INFO Getting cookie named test0
Getting cookie named test0
15:45.63 INFO Getting cookie named test1
Getting cookie named test1
15:45.64 INFO Getting cookie named test2
Getting cookie named test2
15:45.67 INFO Getting cookie named test3
Getting cookie named test3
15:45.68 INFO Getting cookie named test4
Getting cookie named test4
15:45.72 INFO Getting cookie named test5
Getting cookie named test5
15:45.74 INFO Getting cookie named test6
Getting cookie named test6
15:45.75 INFO Getting cookie named test7
Getting cookie named test7
15:45.76 INFO Deleting all cookies
Deleting all cookies
TEST-PASS | /infrastructure/testdriver/get_named_cookie.sub.html | Get Named HTTP cookie 
15:45.87 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_named_cookie.sub.html | took 1206ms
15:45.87 TEST_START: /infrastructure/testdriver/get_named_cookie.sub.https.html
TEST-START | /infrastructure/testdriver/get_named_cookie.sub.https.html
15:45.88 INFO Closing window 7db881bc-5cce-4954-ba8c-8c798f09eaa7
Closing window 7db881bc-5cce-4954-ba8c-8c798f09eaa7
15:46.68 INFO Getting cookie named test0
Getting cookie named test0
15:46.72 INFO Getting cookie named test1
Getting cookie named test1
15:46.72 INFO Getting cookie named test2
Getting cookie named test2
15:46.74 INFO Getting cookie named test3
Getting cookie named test3
15:46.75 INFO Getting cookie named test4
Getting cookie named test4
15:46.75 INFO Getting cookie named test5
Getting cookie named test5
15:46.76 INFO Getting cookie named test6
Getting cookie named test6
15:46.77 INFO Getting cookie named test7
Getting cookie named test7
15:46.79 INFO Getting cookie named test8
Getting cookie named test8
15:46.80 INFO Deleting all cookies
Deleting all cookies
TEST-PASS | /infrastructure/testdriver/get_named_cookie.sub.https.html | Get Named HTTPS cookie 
15:46.90 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_named_cookie.sub.https.html | took 1031ms
15:46.91 TEST_START: /infrastructure/testdriver/send_keys.html
TEST-START | /infrastructure/testdriver/send_keys.html
15:46.91 INFO Closing window 61823273-85b4-49d9-9a9e-d425170e6c2f
Closing window 61823273-85b4-49d9-9a9e-d425170e6c2f
TEST-PASS | /infrastructure/testdriver/send_keys.html | TestDriver send keys method 
15:47.99 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/send_keys.html | took 1081ms
15:47.99 TEST_START: /infrastructure/testdriver/set_get_window_rect.html
TEST-START | /infrastructure/testdriver/set_get_window_rect.html
15:48.00 INFO Closing window 750ee166-74be-4b1c-aa85-5b23ae57c9d8
Closing window 750ee166-74be-4b1c-aa85-5b23ae57c9d8
TEST-FAIL | /infrastructure/testdriver/set_get_window_rect.html | Window Position - promise_test: Unhandled rejection with value: "error: Action set_window_rect failed: Only supported in desktop applications\nstacktrace:\n\tRemoteError@chrome://remote/content/shared/RemoteError.sys.mjs:8:8\n\tWebDriverError@chrome://remote/content/shared/webdriver/Errors.sys.mjs:202:5\n\tUnsupportedOperationError@chrome://remote/content/shared/webdriver/Errors.sys.mjs:978:5\n\tassert.that/<@chrome://remote/content/shared/webdriver/Assert.sys.mjs:581:13\n\tassert.desktop@chrome://remote/content/shared/webdriver/Assert.sys.mjs:74:4\n\tGeckoDriver.prototype.setWindowRect@chrome://remote/content/marionette/driver.sys.mjs:1483:15\n\tdispatch@chrome://remote/content/marionette/server.sys.mjs:318:40\n\texecute@chrome://remote/content/marionette/server.sys.mjs:289:16\n\tonPacket/<@chrome://remote/content/marionette/server.sys.mjs:262:20\n\tonPacket@chrome://remote/content/marionette/server.sys.mjs:263:9\n\t_onJSONObjectReady/<@chrome://remote/content/marionette/transport.sys.mjs:494:20\n"
TEST-FAIL | /infrastructure/testdriver/set_get_window_rect.html | Window Size - promise_test: Unhandled rejection with value: "error: Action set_window_rect failed: Only supported in desktop applications\nstacktrace:\n\tRemoteError@chrome://remote/content/shared/RemoteError.sys.mjs:8:8\n\tWebDriverError@chrome://remote/content/shared/webdriver/Errors.sys.mjs:202:5\n\tUnsupportedOperationError@chrome://remote/content/shared/webdriver/Errors.sys.mjs:978:5\n\tassert.that/<@chrome://remote/content/shared/webdriver/Assert.sys.mjs:581:13\n\tassert.desktop@chrome://remote/content/shared/webdriver/Assert.sys.mjs:74:4\n\tGeckoDriver.prototype.setWindowRect@chrome://remote/content/marionette/driver.sys.mjs:1483:15\n\tdispatch@chrome://remote/content/marionette/server.sys.mjs:318:40\n\texecute@chrome://remote/content/marionette/server.sys.mjs:289:16\n\tonPacket/<@chrome://remote/content/marionette/server.sys.mjs:262:20\n\tonPacket@chrome://remote/content/marionette/server.sys.mjs:263:9\n\t_onJSONObjectReady/<@chrome://remote/content/marionette/transport.sys.mjs:494:20\n"
15:48.57 TEST_END: Test OK. Subtests passed 0/2. Unexpected 0
TEST-OK | /infrastructure/testdriver/set_get_window_rect.html | took 578ms
15:48.57 TEST_START: /infrastructure/testdriver/set_permission.https.html
TEST-START | /infrastructure/testdriver/set_permission.https.html
15:48.60 INFO Closing window f37b0698-9614-46f7-80d7-0419eabe7025
Closing window f37b0698-9614-46f7-80d7-0419eabe7025
TEST-PASS | /infrastructure/testdriver/set_permission.https.html | Grant Permission 
TEST-PASS | /infrastructure/testdriver/set_permission.https.html | Deny Permission 
15:49.46 TEST_END: Test OK. Subtests passed 2/2. Unexpected 0
TEST-OK | /infrastructure/testdriver/set_permission.https.html | took 889ms
15:49.46 TEST_START: /infrastructure/testdriver/virtual_authenticator.html
TEST-START | /infrastructure/testdriver/virtual_authenticator.html
15:49.47 INFO Closing window 89321e7b-2d04-4a97-90e2-c194d007ff98
Closing window 89321e7b-2d04-4a97-90e2-c194d007ff98
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can create an authenticator 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can add a credential 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can get the credentials 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can remove a credential 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can remove all credentials 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can set user verified 
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can remove a virtual authenticator 
15:50.43 TEST_END: Test OK. Subtests passed 7/7. Unexpected 0
TEST-OK | /infrastructure/testdriver/virtual_authenticator.html | took 971ms
15:50.43 TEST_START: /infrastructure/testharness/full.stop/full-stop.html
TEST-START | /infrastructure/testharness/full.stop/full-stop.html
15:50.43 INFO Closing window c69d3bba-c05a-4e89-812f-a3c302a23ab9
Closing window c69d3bba-c05a-4e89-812f-a3c302a23ab9
TEST-PASS | /infrastructure/testharness/full.stop/full-stop.html | full-stop 
15:50.96 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testharness/full.stop/full-stop.html | took 533ms
15:50.96 TEST_START: /infrastructure/testharness/lone-surrogates.html
TEST-START | /infrastructure/testharness/lone-surrogates.html
15:50.97 INFO Closing window 717a0c95-7833-4064-a0d9-36147aa28e0d
Closing window 717a0c95-7833-4064-a0d9-36147aa28e0d
TEST-PASS | /infrastructure/testharness/lone-surrogates.html | passing test with lone surrogate U+d800 in name 
TEST-FAIL | /infrastructure/testharness/lone-surrogates.html | failing test with lone surrogate U+d800 in name - assert_true: expected true got false
@http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:7:25
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2869:25
test@http://web-platform.test:8000/resources/testharness.js:633:30
@http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:7:7
TEST-PASS | /infrastructure/testharness/lone-surrogates.html | passing test with lone surrogate in assert 
TEST-FAIL | /infrastructure/testharness/lone-surrogates.html | failing test with lone surrogate in assert - assert_true: lone U+d800 surrogate expected true got false
@http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:9:25
Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2869:25
test@http://web-platform.test:8000/resources/testharness.js:633:30
@http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:9:7
15:51.52 TEST_END: Test OK. Subtests passed 2/4. Unexpected 0
TEST-OK | /infrastructure/testharness/lone-surrogates.html | took 562ms
15:51.52 TEST_START: /infrastructure/window/minimize-1.html
TEST-START | /infrastructure/window/minimize-1.html
15:51.53 INFO Closing window 2f53de14-38c2-47d3-8039-74641eb0b224
Closing window 2f53de14-38c2-47d3-8039-74641eb0b224
TEST-FAIL | /infrastructure/window/minimize-1.html | Minimize a window - promise_test: Unhandled rejection with value: "error: Action minimize_window failed: Only supported in desktop applications\nstacktrace:\n\tRemoteError@chrome://remote/content/shared/RemoteError.sys.mjs:8:8\n\tWebDriverError@chrome://remote/content/shared/webdriver/Errors.sys.mjs:202:5\n\tUnsupportedOperationError@chrome://remote/content/shared/webdriver/Errors.sys.mjs:978:5\n\tassert.that/<@chrome://remote/content/shared/webdriver/Assert.sys.mjs:581:13\n\tassert.desktop@chrome://remote/content/shared/webdriver/Assert.sys.mjs:74:4\n\tGeckoDriver.prototype.minimizeWindow@chrome://remote/content/marionette/driver.sys.mjs:3065:15\n\tdispatch@chrome://remote/content/marionette/server.sys.mjs:318:40\n\texecute@chrome://remote/content/marionette/server.sys.mjs:289:16\n\tonPacket/<@chrome://remote/content/marionette/server.sys.mjs:262:20\n\tonPacket@chrome://remote/content/marionette/server.sys.mjs:263:9\n\t_onJSONObjectReady/<@chrome://remote/content/marionette/transport.sys.mjs:494:20\n"
15:52.00 TEST_END: Test OK. Subtests passed 0/1. Unexpected 0
TEST-OK | /infrastructure/window/minimize-1.html | took 483ms
15:52.01 TEST_START: /infrastructure/window/minimize-2.html
TEST-START | /infrastructure/window/minimize-2.html
15:52.02 INFO Closing window dd0ef880-919e-42b1-8a90-7df1819c09ee
Closing window dd0ef880-919e-42b1-8a90-7df1819c09ee
TEST-PASS | /infrastructure/window/minimize-2.html | Use testdriver to check window is not minimized 
15:52.46 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/window/minimize-2.html | took 449ms
15:52.46 INFO No more tests
No more tests
15:52.70 INFO Closing logging queue
Closing logging queue
15:53.22 INFO STDOUT: cleanup aborted: args: /home/test/web-platform-tests/_venv3/android/android-sdk-linux/platform-tools/adb wait-for-device remount, exitcode: 1, stdout: Device must be bootloader unlocked
STDOUT: cleanup aborted: args: /home/test/web-platform-tests/_venv3/android/android-sdk-linux/platform-tools/adb wait-for-device remount, exitcode: 1, stdout: Device must be bootloader unlocked
15:52.70 INFO queue closed
queue closed
15:53.88 SUITE_END

web-platform-test
~~~~~~~~~~~~~~~~~
Ran 402 checks (223 subtests, 179 tests)
Expected results: 398 (1 known intermittents)
Skipped: 4 tests
Unexpected results: 0

Known Intermittent Results
--------------------------
/infrastructure/testdriver/actions/elementTiming.html
  KNOWN-INTERMITTENT-FAIL TestDriver actions: element timing - assert_array_equals: expected property 1 to be 150 but got 149 (expected array [50, 150] got [50, 149])
@http://web-platform.test:8000/infrastructure/testdriver/actions/elementTiming.html:67:22
OK
SUITE-END | took 747s
15:53.88 INFO STDOUT: cleanup aborted: args: /home/test/web-platform-tests/_venv3/android/android-sdk-linux/platform-tools/adb wait-for-device remount, exitcode: 1, stdout: Device must be bootloader unlocked
STDOUT: cleanup aborted: args: /home/test/web-platform-tests/_venv3/android/android-sdk-linux/platform-tools/adb wait-for-device remount, exitcode: 1, stdout: Device must be bootloader unlocked
15:53.88 INFO Got 0 unexpected results, with 0 unexpected passes
Got 0 unexpected results, with 0 unexpected passes
15:53.88 wptserve INFO Stopped http server on 127.0.0.1:8000
wptserve Stopped http server on 127.0.0.1:8000
15:53.89 wptserve INFO Stopped http server on 127.0.0.1:8001
wptserve Stopped http server on 127.0.0.1:8001
15:53.91 wptserve INFO Stopped http server on 127.0.0.1:8002
wptserve Stopped http server on 127.0.0.1:8002
15:53.91 wptserve INFO Stopped http server on 127.0.0.1:8003
wptserve Stopped http server on 127.0.0.1:8003
15:53.91 wptserve INFO Stopped http server on 127.0.0.1:8443
wptserve Stopped http server on 127.0.0.1:8443
15:53.94 wptserve INFO Stopped http server on 127.0.0.1:8444
wptserve Stopped http server on 127.0.0.1:8444
15:53.94 wptserve INFO Stopped http server on 127.0.0.1:8445
wptserve Stopped http server on 127.0.0.1:8445
15:53.94 wptserve INFO Stopped http server on 127.0.0.1:8446
wptserve Stopped http server on 127.0.0.1:8446
15:53.95 wptserve INFO Stopped http server on 127.0.0.1:9000
wptserve Stopped http server on 127.0.0.1:9000
15:54.14 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
15:54.42 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
15:54.54 INFO Removed font: Ahem.ttf
Removed font: Ahem.ttf
15:54.56 INFO Closing logging queue
Closing logging queue
15:54.56 INFO queue closed
queue closed
[taskcluster 2025-12-18 01:44:34.393Z] === Task Finished ===
[taskcluster 2025-12-18 01:44:36.483Z] Successful task run with exit code: 0 completed in 1044.352 seconds
View more details on Community-TC Integration