Make it easier to run locally in a docker image #57044
Community-TC (pull_request)
Smoketests for wptrunner in firefox_android.
Details
View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster
Task Status
Started: 2026-01-08T09:36:28.411Z
Resolved: 2026-01-08T09:54:34.007Z
Task Execution Time: 18 minutes, 5 seconds, 596 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0
Artifacts
- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md
- public/results/emulator.log
- public/results/logcat-emulator-5554.log
- public/results/wptreport-firefox_android.json.gz
WPT Command: python3 ./wpt run --log-tbpl=- --log-wptreport=../artifacts/wptreport-firefox_android.json --logcat-dir=../artifacts/ --metadata=infrastructure/metadata/ --include=infrastructure/ --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --verify-log-full --no-headless --install-browser --install-webdriver --logcat-dir /home/test/artifacts/ firefox_android
[taskcluster 2026-01-08 09:36:28.479Z] Task ID: Y6u9snu0SyOG9fg7lelIjg
[taskcluster 2026-01-08 09:36:28.479Z] Worker ID: 959287382508818441
[taskcluster 2026-01-08 09:36:28.479Z] Worker Group: us-east1-b
[taskcluster 2026-01-08 09:36:28.479Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2026-01-08 09:36:28.479Z] Worker Pool: proj-wpt/ci
[taskcluster 2026-01-08 09:36:28.479Z] Worker Version: 46.1.0
[taskcluster 2026-01-08 09:36:28.479Z] Public IP: 35.196.90.39
[taskcluster 2026-01-08 09:36:28.479Z] Hostname: proj-wpt-ci-iwvd5gjiq1w562owzkq2hw
[taskcluster 2026-01-08 09:36:29.540Z] === Task Starting ===
+ '[' '' ']'
+ '[' -d /etc/profile.d ']'
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/01-locale-fix.sh ']'
+ . /etc/profile.d/01-locale-fix.sh
+++ /usr/bin/locale-check C.UTF-8
++ eval
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/apps-bin-path.sh ']'
+ . /etc/profile.d/apps-bin-path.sh
...(4181 lines hidden)...
TEST-PASS | /infrastructure/reftest/reftest_match_and_mismatch-3.html | took 1849ms
14:59.20 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-4.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-4.html
15:02.01 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-4.html | took 2819ms
15:02.01 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-5.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-5.html
15:04.72 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-5.html | took 2700ms
15:04.72 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-6.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-6.html
15:09.59 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-6.html | took 4873ms
15:09.59 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-7.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-7.html
15:12.72 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-7.html | took 3129ms
15:12.72 TEST_START: /infrastructure/reftest/reftest_match_fail.html
TEST-START | /infrastructure/reftest/reftest_match_fail.html
15:13.63 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_fail.html | took 910ms
15:13.63 TEST_START: /infrastructure/reftest/reftest_mismatch.html
TEST-START | /infrastructure/reftest/reftest_mismatch.html
15:14.58 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_mismatch.html | took 951ms
15:14.58 TEST_START: /infrastructure/reftest/reftest_mismatch_fail.html
TEST-START | /infrastructure/reftest/reftest_mismatch_fail.html
15:15.55 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_mismatch_fail.html | took 971ms
15:15.56 TEST_START: /infrastructure/reftest/reftest_multiple_match-0.html
TEST-START | /infrastructure/reftest/reftest_multiple_match-0.html
15:17.45 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_multiple_match-0.html | took 1895ms
15:17.45 TEST_START: /infrastructure/reftest/reftest_multiple_match-1.html
TEST-START | /infrastructure/reftest/reftest_multiple_match-1.html
15:18.49 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_multiple_match-1.html | took 1041ms
15:18.49 TEST_START: /infrastructure/reftest/reftest_multiple_mismatch-0.html
TEST-START | /infrastructure/reftest/reftest_multiple_mismatch-0.html
15:21.36 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_multiple_mismatch-0.html | took 2867ms
15:21.36 TEST_START: /infrastructure/reftest/reftest_multiple_mismatch-1.html
TEST-START | /infrastructure/reftest/reftest_multiple_mismatch-1.html
15:22.37 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_multiple_mismatch-1.html | took 1013ms
15:22.37 TEST_START: /infrastructure/reftest/reftest_ref_timeout.html
TEST-START | /infrastructure/reftest/reftest_ref_timeout.html
15:42.46 TEST_END: TIMEOUT
TEST-TIMEOUT | /infrastructure/reftest/reftest_ref_timeout.html | took 20091ms
15:42.46 TEST_START: /infrastructure/reftest/reftest_timeout.html
TEST-START | /infrastructure/reftest/reftest_timeout.html
mem avail: 9138 of 15806 MiB (57.82%), swap free: 0 of 0 MiB ( 0.00%)
16:02.55 TEST_END: TIMEOUT
TEST-TIMEOUT | /infrastructure/reftest/reftest_timeout.html | took 20087ms
16:02.55 TEST_START: /infrastructure/reftest/reftest_wait_0.html
TEST-START | /infrastructure/reftest/reftest_wait_0.html
16:05.82 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_wait_0.html | took 3265ms
16:05.82 TEST_START: /infrastructure/reftest/reftest_wait_TestRendered.html
TEST-START | /infrastructure/reftest/reftest_wait_TestRendered.html
16:06.93 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_wait_TestRendered.html | took 1112ms
16:06.93 TEST_START: /infrastructure/reftest/reftest_window_load.html
TEST-START | /infrastructure/reftest/reftest_window_load.html
16:08.09 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_window_load.html | took 1164ms
16:08.09 TEST_START: /infrastructure/reftest/size.html
TEST-START | /infrastructure/reftest/size.html
16:09.26 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/size.html | took 1167ms
16:09.26 TEST_START: /infrastructure/reftest/testdriver-in-ref.html
TEST-START | /infrastructure/reftest/testdriver-in-ref.html
16:29.43 TEST_END: TIMEOUT
TEST-TIMEOUT | /infrastructure/reftest/testdriver-in-ref.html | took 20172ms
16:29.43 TEST_START: /infrastructure/reftest-wait.html
TEST-START | /infrastructure/reftest-wait.html
16:31.63 TEST_END: PASS
TEST-PASS | /infrastructure/reftest-wait.html | took 2195ms
16:31.63 INFO Restarting browser for new test group
Restarting browser for new test group
16:32.45 INFO STDOUT: cleanup aborted: args: /home/test/web-platform-tests/_venv3/android/android-sdk-linux/platform-tools/adb wait-for-device remount, exitcode: 1, stdout: Device must be bootloader unlocked
STDOUT: cleanup aborted: args: /home/test/web-platform-tests/_venv3/android/android-sdk-linux/platform-tools/adb wait-for-device remount, exitcode: 1, stdout: Device must be bootloader unlocked
16:31.82 INFO Closing logging queue
Closing logging queue
16:31.83 INFO queue closed
queue closed
16:32.81 INFO STDOUT: cleanup aborted: args: /home/test/web-platform-tests/_venv3/android/android-sdk-linux/platform-tools/adb wait-for-device remount, exitcode: 1, stdout: Device must be bootloader unlocked
STDOUT: cleanup aborted: args: /home/test/web-platform-tests/_venv3/android/android-sdk-linux/platform-tools/adb wait-for-device remount, exitcode: 1, stdout: Device must be bootloader unlocked
16:32.83 INFO --certutil-binary not supplied; Firefox will not check certificates
--certutil-binary not supplied; Firefox will not check certificates
16:34.04 web-platform-tests INFO Granting important runtime permissions to org.mozilla.geckoview.test_runner
web-platform-tests Granting important runtime permissions to org.mozilla.geckoview.test_runner
16:38.13 web-platform-tests WARNING Unable to grant runtime permission android.permission.READ_EXTERNAL_STORAGE to org.mozilla.geckoview.test_runner due to args: /home/test/web-platform-tests/_venv3/android/android-sdk-linux/platform-tools/adb wait-for-device shell pm grant org.mozilla.geckoview.test_runner android.permission.READ_EXTERNAL_STORAGE; echo adb_returncode=$?, exitcode: 255, stdout:
Exception occurred while executing 'grant':
java.lang.SecurityException: Package org.mozilla.geckoview.test_runner has not requested permission android.permission.READ_EXTERNAL_STORAGE
at com.android.server.pm.permission.PermissionManagerServiceImpl.grantRuntimePermissionInternal(PermissionManagerServiceImpl.java:1423)
at com.android.server.pm.permission.PermissionManagerServiceImpl.grantRuntimePermission(PermissionManagerServiceImpl.java:1337)
at com.android.server.pm.permission.PermissionManagerService.grantRuntimePermission(PermissionManagerService.java:551)
at android.permission.PermissionManager.grantRuntimePermission(PermissionManager.java:609)
at com.android.server.pm.PackageManagerShellCommand.runGrantRevokePermission(PackageManagerShellCommand.java:2672)
at com.android.server.pm.PackageManagerShellCommand.onCommand(PackageManagerShellCommand.java:291)
at com.android.modules.utils.BasicShellCommandHandler.exec(BasicShellCommandHandler.java:97)
at android.os.ShellCommand.exec(ShellCommand.java:38)
at com.android.server.pm.PackageManagerService$IPackageManagerImpl.onShellCommand(PackageManagerService.java:6350)
at android.os.Binder.shellCommand(Binder.java:1068)
at android.os.Binder.onTransact(Binder.java:888)
at android.content.pm.IPackageManager$Stub.onTransact(IPackageManager.java:4352)
at com.android.server.pm.PackageManagerService$IPackageManagerImpl.onTransact(PackageManagerService.java:6334)
at android.os.Binder.execTransactInternal(Binder.java:1344)
at android.os.Binder.execTransact(Binder.java:1275)
web-platform-tests Unable to grant runtime permission android.permission.READ_EXTERNAL_STORAGE to org.mozilla.geckoview.test_runner due to args: /home/test/web-platform-tests/_venv3/android/android-sdk-linux/platform-tools/adb wait-for-device shell pm grant org.mozilla.geckoview.test_runner android.permission.READ_EXTERNAL_STORAGE; echo adb_returncode=$?, exitcode: 255, stdout:
Exception occurred while executing 'grant':
java.lang.SecurityException: Package org.mozilla.geckoview.test_runner has not requested permission android.permission.READ_EXTERNAL_STORAGE
at com.android.server.pm.permission.PermissionManagerServiceImpl.grantRuntimePermissionInternal(PermissionManagerServiceImpl.java:1423)
at com.android.server.pm.permission.PermissionManagerServiceImpl.grantRuntimePermission(PermissionManagerServiceImpl.java:1337)
at com.android.server.pm.permission.PermissionManagerService.grantRuntimePermission(PermissionManagerService.java:551)
at android.permission.PermissionManager.grantRuntimePermission(PermissionManager.java:609)
at com.android.server.pm.PackageManagerShellCommand.runGrantRevokePermission(PackageManagerShellCommand.java:2672)
at com.android.server.pm.PackageManagerShellCommand.onCommand(PackageManagerShellCommand.java:291)
at com.android.modules.utils.BasicShellCommandHandler.exec(BasicShellCommandHandler.java:97)
at android.os.ShellCommand.exec(ShellCommand.java:38)
at com.android.server.pm.PackageManagerService$IPackageManagerImpl.onShellCommand(PackageManagerService.java:6350)
at android.os.Binder.shellCommand(Binder.java:1068)
at android.os.Binder.onTransact(Binder.java:888)
at android.content.pm.IPackageManager$Stub.onTransact(IPackageManager.java:4352)
at com.android.server.pm.PackageManagerService$IPackageManagerImpl.onTransact(PackageManagerService.java:6334)
at android.os.Binder.execTransactInternal(Binder.java:1344)
at android.os.Binder.execTransact(Binder.java:1275)
16:38.25 web-platform-tests INFO launch_application: am start -W -n org.mozilla.geckoview.test_runner/org.mozilla.geckoview.test_runner.TestRunnerActivity -a android.intent.action.MAIN --es env0 MOZ_CRASHREPORTER=1 --es env1 MOZ_CRASHREPORTER_NO_REPORT=1 --es env2 MOZ_CRASHREPORTER_SHUTDOWN=1 --es env3 MOZ_HIDE_RESULTS_TABLE=1 --es env4 MOZ_IN_AUTOMATION=1 --es env5 MOZ_LOG=signaling:3,mtransport:4,DataChannel:4,jsep:4 --es env6 R_LOG_LEVEL=6 --es env7 R_LOG_DESTINATION=stderr --es env8 R_LOG_VERBOSE=1 --es env9 MOZ_PROCESS_LOG=/tmp/tmpvh368044pidlog --es env10 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es arg0 -no-remote --es arg1 -profile --es arg2 /data/local/tmp/test_root/profile --es arg3 --marionette --es arg4 --remote-allow-system-access --es arg5 about:blank
web-platform-tests launch_application: am start -W -n org.mozilla.geckoview.test_runner/org.mozilla.geckoview.test_runner.TestRunnerActivity -a android.intent.action.MAIN --es env0 MOZ_CRASHREPORTER=1 --es env1 MOZ_CRASHREPORTER_NO_REPORT=1 --es env2 MOZ_CRASHREPORTER_SHUTDOWN=1 --es env3 MOZ_HIDE_RESULTS_TABLE=1 --es env4 MOZ_IN_AUTOMATION=1 --es env5 MOZ_LOG=signaling:3,mtransport:4,DataChannel:4,jsep:4 --es env6 R_LOG_LEVEL=6 --es env7 R_LOG_DESTINATION=stderr --es env8 R_LOG_VERBOSE=1 --es env9 MOZ_PROCESS_LOG=/tmp/tmpvh368044pidlog --es env10 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es arg0 -no-remote --es arg1 -profile --es arg2 /data/local/tmp/test_root/profile --es arg3 --marionette --es arg4 --remote-allow-system-access --es arg5 about:blank
16:40.81 INFO Starting runner
Starting runner
16:42.86 TEST_START: /infrastructure/crashtests/example.html
TEST-START | /infrastructure/crashtests/example.html
16:44.18 TEST_END: PASS
TEST-PASS | /infrastructure/crashtests/example.html | took 1322ms
16:44.18 TEST_START: /infrastructure/crashtests/testdriver.html
TEST-START | /infrastructure/crashtests/testdriver.html
16:44.76 TEST_END: PASS
TEST-PASS | /infrastructure/crashtests/testdriver.html | took 574ms
16:44.76 INFO No more tests
No more tests
mem avail: 9145 of 15806 MiB (57.86%), swap free: 0 of 0 MiB ( 0.00%)
16:45.69 INFO STDOUT: cleanup aborted: args: /home/test/web-platform-tests/_venv3/android/android-sdk-linux/platform-tools/adb wait-for-device remount, exitcode: 1, stdout: Device must be bootloader unlocked
STDOUT: cleanup aborted: args: /home/test/web-platform-tests/_venv3/android/android-sdk-linux/platform-tools/adb wait-for-device remount, exitcode: 1, stdout: Device must be bootloader unlocked
16:44.93 INFO Closing logging queue
Closing logging queue
16:44.93 INFO queue closed
queue closed
16:46.23 INFO STDOUT: cleanup aborted: args: /home/test/web-platform-tests/_venv3/android/android-sdk-linux/platform-tools/adb wait-for-device remount, exitcode: 1, stdout: Device must be bootloader unlocked
STDOUT: cleanup aborted: args: /home/test/web-platform-tests/_venv3/android/android-sdk-linux/platform-tools/adb wait-for-device remount, exitcode: 1, stdout: Device must be bootloader unlocked
16:46.24 SUITE_END
web-platform-test
~~~~~~~~~~~~~~~~~
Ran 402 checks (223 subtests, 179 tests)
Expected results: 398 (1 known intermittents)
Skipped: 4 tests
Unexpected results: 0
Known Intermittent Results
--------------------------
/infrastructure/testdriver/actions/elementTiming.html
KNOWN-INTERMITTENT-FAIL TestDriver actions: element timing - assert_array_equals: expected property 1 to be 150 but got 149 (expected array [50, 150] got [50, 149])
@http://web-platform.test:8000/infrastructure/testdriver/actions/elementTiming.html:67:22
OK
SUITE-END | took 763s
16:46.24 INFO Got 0 unexpected results, with 0 unexpected passes
Got 0 unexpected results, with 0 unexpected passes
16:46.25 wptserve INFO Stopped http server on 127.0.0.1:8000
wptserve Stopped http server on 127.0.0.1:8000
16:46.25 wptserve INFO Stopped http server on 127.0.0.1:8001
wptserve Stopped http server on 127.0.0.1:8001
16:46.25 wptserve INFO Stopped http server on 127.0.0.1:8002
wptserve Stopped http server on 127.0.0.1:8002
16:46.26 wptserve INFO Stopped http server on 127.0.0.1:8003
wptserve Stopped http server on 127.0.0.1:8003
16:46.28 wptserve INFO Stopped http server on 127.0.0.1:8443
wptserve Stopped http server on 127.0.0.1:8443
16:46.28 wptserve INFO Stopped http server on 127.0.0.1:8444
wptserve Stopped http server on 127.0.0.1:8444
16:46.29 wptserve INFO Stopped http server on 127.0.0.1:8445
wptserve Stopped http server on 127.0.0.1:8445
16:46.29 wptserve INFO Stopped http server on 127.0.0.1:8446
wptserve Stopped http server on 127.0.0.1:8446
16:46.29 wptserve INFO Stopped http server on 127.0.0.1:9000
wptserve Stopped http server on 127.0.0.1:9000
16:46.51 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
16:46.78 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
16:46.84 INFO Removed font: Ahem.ttf
Removed font: Ahem.ttf
16:46.87 INFO Closing logging queue
Closing logging queue
16:46.87 INFO queue closed
queue closed
[taskcluster 2026-01-08 09:54:29.664Z] === Task Finished ===
[taskcluster 2026-01-08 09:54:31.632Z] Successful task run with exit code: 0 completed in 1083.153 seconds