Skip to content

feat(manifest): Add initial tooling for Test262 test types [pt 1/5] #56840

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
jcscottiii wants to merge 5 commits into
base: master
Choose a base branch
from

fix type hints for earlier python versions

28a3a4b
Select commit
Loading
Failed to load commit list.
Open

feat(manifest): Add initial tooling for Test262 test types [pt 1/5] #56840

fix type hints for earlier python versions
28a3a4b
Select commit
Loading
Failed to load commit list.
Community-TC Integration / infrastructure/ tests (firefox_android) succeeded Dec 19, 2025 in 18m 17s

Community-TC (pull_request)

Smoketests for wptrunner in firefox_android.

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2025-12-19T18:09:46.542Z
Resolved: 2025-12-19T18:27:02.400Z
Task Execution Time: 17 minutes, 15 seconds, 858 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md
- public/results/emulator.log
- public/results/logcat-emulator-5554.log
- public/results/wptreport-firefox_android.json.gz

WPT Command: python3 ./wpt run --log-tbpl=- --log-wptreport=../artifacts/wptreport-firefox_android.json --logcat-dir=../artifacts/ --metadata=infrastructure/metadata/ --include=infrastructure/ --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --verify-log-full --no-headless --install-browser --install-webdriver --logcat-dir /home/test/artifacts/ firefox_android

[taskcluster 2025-12-19 18:09:46.643Z] Task ID: EvnDf9WwSDO0-Vf-jdh5Ig
[taskcluster 2025-12-19 18:09:46.643Z] Worker ID: 583502225421642330
[taskcluster 2025-12-19 18:09:46.643Z] Worker Group: us-central1-b
[taskcluster 2025-12-19 18:09:46.643Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2025-12-19 18:09:46.643Z] Worker Pool: proj-wpt/ci
[taskcluster 2025-12-19 18:09:46.643Z] Worker Version: 46.1.0
[taskcluster 2025-12-19 18:09:46.643Z] Public IP: 34.72.15.131
[taskcluster 2025-12-19 18:09:46.643Z] Hostname: proj-wpt-ci-awya7x-mt4ad5zdlabzopq

ac811f28856d - Started downloading
8f84a9f2102e - Started downloading
ac811f28856d - Downloaded in 0.031 seconds
40516d781e70 - Started downloading
44ebbf800033 - Started downloading
44ebbf800033 - Downloaded in 0.043 seconds
8f84a9f2102e - Downloaded in 0.208 seconds
4f4fb700ef54 - Started downloading
4f4fb700ef54 - Downloaded in 0.001 seconds
a8884b21e40e - Started downloading
79c347416ee8 - Started downloading

...(4104 lines hidden)...

TEST-START | /infrastructure/reftest/legacy/reftest_cycle_fail.html
13:10.63 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/legacy/reftest_cycle_fail.html | took 708ms
13:10.63 TEST_START: /infrastructure/reftest/legacy/reftest_cycle_fail_0-ref.html
TEST-START | /infrastructure/reftest/legacy/reftest_cycle_fail_0-ref.html
13:11.36 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/legacy/reftest_cycle_fail_0-ref.html | took 731ms
13:11.36 TEST_START: /infrastructure/reftest/legacy/reftest_fuzzy_chain_ini.html
TEST-START | /infrastructure/reftest/legacy/reftest_fuzzy_chain_ini.html
13:12.25 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/legacy/reftest_fuzzy_chain_ini.html | took 888ms
13:12.25 TEST_START: /infrastructure/reftest/reftest.https.html
TEST-START | /infrastructure/reftest/reftest.https.html
13:13.17 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest.https.html | took 922ms
13:13.17 TEST_START: /infrastructure/reftest/reftest.www.sub.html
TEST-START | /infrastructure/reftest/reftest.www.sub.html
13:13.99 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest.www.sub.html | took 823ms
13:13.99 TEST_START: /infrastructure/reftest/reftest_fuzzy_1.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_1.html
13:15.01 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_1.html | took 1018ms
13:15.01 TEST_START: /infrastructure/reftest/reftest_fuzzy_ini_full.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_ini_full.html
13:15.82 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_ini_full.html | took 804ms
13:15.82 TEST_START: /infrastructure/reftest/reftest_fuzzy_ini_ref_only.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_ini_ref_only.html
13:16.67 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_ini_ref_only.html | took 853ms
13:16.67 TEST_START: /infrastructure/reftest/reftest_fuzzy_ini_short.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_ini_short.html
13:17.54 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_ini_short.html | took 868ms
13:17.54 TEST_START: /infrastructure/reftest/reftest_fuzzy_no_differences.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_no_differences.html
13:18.38 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_no_differences.html | took 841ms
13:18.38 TEST_START: /infrastructure/reftest/reftest_fuzzy_no_differences_1.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_no_differences_1.html
13:19.22 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_no_differences_1.html | took 835ms
13:19.22 TEST_START: /infrastructure/reftest/reftest_match.html
TEST-START | /infrastructure/reftest/reftest_match.html
13:20.02 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_match.html | took 801ms
13:20.02 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-0.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-0.html
13:21.59 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-0.html | took 1574ms
13:21.59 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-1.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-1.html
13:23.20 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-1.html | took 1604ms
13:23.20 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-2.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-2.html
13:25.52 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_match_and_mismatch-2.html | took 2320ms
13:25.52 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-3.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-3.html
13:26.98 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_match_and_mismatch-3.html | took 1461ms
13:26.98 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-4.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-4.html
13:29.07 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-4.html | took 2089ms
13:29.07 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-5.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-5.html
13:31.23 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-5.html | took 2160ms
13:31.23 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-6.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-6.html
13:34.87 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-6.html | took 3647ms
13:34.87 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-7.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-7.html
13:37.11 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-7.html | took 2240ms
13:37.11 TEST_START: /infrastructure/reftest/reftest_match_fail.html
TEST-START | /infrastructure/reftest/reftest_match_fail.html
13:37.72 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_fail.html | took 609ms
13:37.72 TEST_START: /infrastructure/reftest/reftest_mismatch.html
TEST-START | /infrastructure/reftest/reftest_mismatch.html
13:38.49 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_mismatch.html | took 766ms
13:38.49 TEST_START: /infrastructure/reftest/reftest_mismatch_fail.html
TEST-START | /infrastructure/reftest/reftest_mismatch_fail.html
13:39.22 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_mismatch_fail.html | took 726ms
13:39.22 TEST_START: /infrastructure/reftest/reftest_multiple_match-0.html
TEST-START | /infrastructure/reftest/reftest_multiple_match-0.html
13:40.87 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_multiple_match-0.html | took 1657ms
13:40.87 TEST_START: /infrastructure/reftest/reftest_multiple_match-1.html
TEST-START | /infrastructure/reftest/reftest_multiple_match-1.html
13:41.62 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_multiple_match-1.html | took 747ms
13:41.62 TEST_START: /infrastructure/reftest/reftest_multiple_mismatch-0.html
TEST-START | /infrastructure/reftest/reftest_multiple_mismatch-0.html
13:43.80 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_multiple_mismatch-0.html | took 2178ms
13:43.80 TEST_START: /infrastructure/reftest/reftest_multiple_mismatch-1.html
TEST-START | /infrastructure/reftest/reftest_multiple_mismatch-1.html
13:44.57 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_multiple_mismatch-1.html | took 776ms
13:44.57 TEST_START: /infrastructure/reftest/reftest_ref_timeout.html
TEST-START | /infrastructure/reftest/reftest_ref_timeout.html
mem avail:  9171 of 15806 MiB (58.02%), swap free:    0 of    0 MiB ( 0.00%)
14:04.64 TEST_END: TIMEOUT
TEST-TIMEOUT | /infrastructure/reftest/reftest_ref_timeout.html | took 20067ms
14:04.64 TEST_START: /infrastructure/reftest/reftest_timeout.html
TEST-START | /infrastructure/reftest/reftest_timeout.html
14:24.71 TEST_END: TIMEOUT
TEST-TIMEOUT | /infrastructure/reftest/reftest_timeout.html | took 20070ms
14:24.71 TEST_START: /infrastructure/reftest/reftest_wait_0.html
TEST-START | /infrastructure/reftest/reftest_wait_0.html
14:27.63 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_wait_0.html | took 2919ms
14:27.63 TEST_START: /infrastructure/reftest/reftest_wait_TestRendered.html
TEST-START | /infrastructure/reftest/reftest_wait_TestRendered.html
14:28.58 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_wait_TestRendered.html | took 944ms
14:28.58 TEST_START: /infrastructure/reftest/reftest_window_load.html
TEST-START | /infrastructure/reftest/reftest_window_load.html
14:29.50 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_window_load.html | took 922ms
14:29.50 TEST_START: /infrastructure/reftest/size.html
TEST-START | /infrastructure/reftest/size.html
14:30.36 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/size.html | took 863ms
14:30.36 TEST_START: /infrastructure/reftest/testdriver-in-ref.html
TEST-START | /infrastructure/reftest/testdriver-in-ref.html
mem avail:  9170 of 15806 MiB (58.02%), swap free:    0 of    0 MiB ( 0.00%)
14:50.49 TEST_END: TIMEOUT
TEST-TIMEOUT | /infrastructure/reftest/testdriver-in-ref.html | took 20131ms
14:50.49 TEST_START: /infrastructure/reftest-wait.html
TEST-START | /infrastructure/reftest-wait.html
14:52.39 TEST_END: PASS
TEST-PASS | /infrastructure/reftest-wait.html | took 1893ms
14:52.39 INFO No more tests
No more tests
14:52.53 INFO Closing logging queue
Closing logging queue
14:52.53 INFO queue closed
queue closed
14:52.96 INFO STDOUT: cleanup aborted: args: /home/test/web-platform-tests/_venv3/android/android-sdk-linux/platform-tools/adb wait-for-device remount, exitcode: 1, stdout: Device must be bootloader unlocked
STDOUT: cleanup aborted: args: /home/test/web-platform-tests/_venv3/android/android-sdk-linux/platform-tools/adb wait-for-device remount, exitcode: 1, stdout: Device must be bootloader unlocked
14:53.19 INFO STDOUT: cleanup aborted: args: /home/test/web-platform-tests/_venv3/android/android-sdk-linux/platform-tools/adb wait-for-device remount, exitcode: 1, stdout: Device must be bootloader unlocked
STDOUT: cleanup aborted: args: /home/test/web-platform-tests/_venv3/android/android-sdk-linux/platform-tools/adb wait-for-device remount, exitcode: 1, stdout: Device must be bootloader unlocked
14:53.19 SUITE_END

web-platform-test
~~~~~~~~~~~~~~~~~
Ran 402 checks (223 subtests, 179 tests)
Expected results: 398 (1 known intermittents)
Skipped: 4 tests
Unexpected results: 0

Known Intermittent Results
--------------------------
/infrastructure/testdriver/actions/elementTiming.html
  KNOWN-INTERMITTENT-FAIL TestDriver actions: element timing - assert_array_equals: expected property 1 to be 150 but got 149 (expected array [50, 150] got [50, 149])
@http://web-platform.test:8000/infrastructure/testdriver/actions/elementTiming.html:67:22
OK
SUITE-END | took 691s
14:53.19 INFO Got 0 unexpected results, with 0 unexpected passes
Got 0 unexpected results, with 0 unexpected passes
14:53.19 wptserve INFO Stopped http server on 127.0.0.1:8000
wptserve Stopped http server on 127.0.0.1:8000
14:53.19 wptserve INFO Stopped http server on 127.0.0.1:8001
wptserve Stopped http server on 127.0.0.1:8001
14:53.20 wptserve INFO Stopped http server on 127.0.0.1:8002
wptserve Stopped http server on 127.0.0.1:8002
14:53.20 wptserve INFO Stopped http server on 127.0.0.1:8003
wptserve Stopped http server on 127.0.0.1:8003
14:53.21 wptserve INFO Stopped http server on 127.0.0.1:8443
wptserve Stopped http server on 127.0.0.1:8443
14:53.21 wptserve INFO Stopped http server on 127.0.0.1:8444
wptserve Stopped http server on 127.0.0.1:8444
14:53.21 wptserve INFO Stopped http server on 127.0.0.1:8445
wptserve Stopped http server on 127.0.0.1:8445
14:53.21 wptserve INFO Stopped http server on 127.0.0.1:8446
wptserve Stopped http server on 127.0.0.1:8446
14:53.21 wptserve INFO Stopped http server on 127.0.0.1:9000
wptserve Stopped http server on 127.0.0.1:9000
14:53.24 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
14:53.48 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
14:53.67 INFO Removed font: Ahem.ttf
Removed font: Ahem.ttf
14:53.69 INFO Closing logging queue
Closing logging queue
14:53.69 INFO queue closed
queue closed
[taskcluster 2025-12-19 18:26:59.446Z] === Task Finished ===
[taskcluster 2025-12-19 18:27:01.385Z] Successful task run with exit code: 0 completed in 1034.745 seconds
View more details on Community-TC Integration