Skip to content

Update neglected tests

9bee018
Select commit
Loading
Failed to load commit list.
Merged

webdriver: Fix outdated timeouts test and remove redundant check #56959

Update neglected tests
9bee018
Select commit
Loading
Failed to load commit list.
Community-TC Integration / wpt-chrome-dev-results-without-changes succeeded Jan 5, 2026 in 2m 53s

Community-TC (pull_request)

Collect results for all tests affected by a pull request in chrome but without the changes in the PR.

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2026-01-05T11:09:47.825Z
Resolved: 2026-01-05T11:12:30.129Z
Task Execution Time: 2 minutes, 42 seconds, 304 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md
- public/results/wpt_report.json.gz
- public/results/wpt_screenshot.txt.gz

WPT Command: python3 ./wpt run --channel=dev --no-fail-on-unexpected --log-wptreport=../artifacts/wpt_report.json --log-wptscreenshot=../artifacts/wpt_screenshot.txt --affected task_head --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --verify-log-full --no-headless --enable-swiftshader --install-browser --install-webdriver chrome


[taskcluster 2026-01-05 11:09:47.925Z] Task ID: YIF_h7DQTzG3quzqFaU5_Q
[taskcluster 2026-01-05 11:09:47.925Z] Worker ID: 6629697240425703681
[taskcluster 2026-01-05 11:09:47.925Z] Worker Group: us-east1-d
[taskcluster 2026-01-05 11:09:47.925Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2026-01-05 11:09:47.925Z] Worker Pool: proj-wpt/ci
[taskcluster 2026-01-05 11:09:47.925Z] Worker Version: 46.1.0
[taskcluster 2026-01-05 11:09:47.925Z] Public IP: 35.231.243.195
[taskcluster 2026-01-05 11:09:47.925Z] Hostname: proj-wpt-ci-ttieeculq863x-9lwt4hja

[taskcluster 2026-01-05 11:09:48.878Z] === Task Starting ===
+ '[' '' ']'
+ '[' -d /etc/profile.d ']'
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/01-locale-fix.sh ']'
+ . /etc/profile.d/01-locale-fix.sh
+++ /usr/bin/locale-check C.UTF-8
++ eval
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/apps-bin-path.sh ']'
+ . /etc/profile.d/apps-bin-path.sh

...(3444 lines hidden)...

                                                 '--short-reporting-delay',
                                                 '--host-resolver-rules=MAP '
                                                 'nonexistent.*.test '
                                                 '^NOTFOUND, MAP *.test '
                                                 '127.0.0.1, MAP *.test. '
                                                 '127.0.0.1',
                                                 '--enable-features=SecurePaymentConfirmationBrowser',
                                                 '--webtransport-developer-mode',
                                                 '--enable-features=GenericSensorExtraClasses',
                                                 '--disable-infobars',
                                                 '--enable-features=WebMachineLearningNeuralNetwork',
                                                 '--enable-features=InstallOnDeviceSpeechRecognition,OnDeviceWebSpeechAvailable,OnDeviceWebSpeech,MediaStreamTrackWebSpeech,WebSpeechRecognitionContext',
                                                 '--enable-unsafe-extension-debugging',
                                                 '--remote-debugging-pipe',
                                                 '--ip-address-space-overrides=127.0.0.1:8002=local,127.0.0.1:8003=public,127.0.0.1:8445=local,127.0.0.1:8446=public',
                                                 '--disable-features=ScrollbarAnimations',
                                                 '--enable-blink-features=ViewTransitionLongCallbackTimeoutForTesting,NoFontAntialiasing,MojoJS,MojoJSTest',
                                                 '--use-gl=angle',
                                                 '--use-angle=swiftshader',
                                                 '--enable-unsafe-swiftshader',
                                                 '--no-sandbox',
                                                 '--enable-experimental-web-platform-features'],
                                        'binary': '/home/test/web-platform-tests/_venv3/browsers/dev/chrome-linux64/chrome',
                                        'excludeSwitches': ['enable-automation'],
                                        'prefs': {'profile': {'default_content_setting_values': {'popups': 1}}},
                                        'w3c': True},
                 'unhandledPromptBehavior': {'beforeunload': 'bar'}}}
key        = 'unhandledPromptBehavior'
new_session = <function fixture_new_session.<locals>.new_session at 0x7f1ab5122e60>
response   = <Response: status=200 body={"value": {"capabilities": {"acceptInsecureCerts": false, "browserName": "chrome", "browserVersion": "145.0.7572.2", "chrome": {"chromedriverVersion": "145.0.7572.2 (68918169e6422bcf7c8ca8cdea509443a35f96a4-refs/branch-heads/7572@{#6})", "userDataDir": "/tmp/org.chromium.Chromium.scoped_dir.ZamEqX"}, "fedcm:accounts": true, "goog:processID": 8142, "networkConnectionEnabled": false, "pageLoadStrategy": "normal", "platformName": "linux", "proxy": {}, "setWindowRect": true, "strictFileInteractability": false, "timeouts": {"implicit": 0, "pageLoad": 300000, "script": 30000}, "unhandledPromptBehavior": {"beforeunload": "bar"}, "webauthn:extension:credBlob": true, "webauthn:extension:largeBlob": true, "webauthn:extension:minPinLength": true, "webauthn:extension:prf": true, "webauthn:virtualAuthenticators": true}, "sessionId": "fb2b384571be05ef97c00c7f635004f8"}}>
value      = {'beforeunload': 'bar'}

webdriver/tests/classic/new_session/invalid_capabilities.py:42: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

response = <Response: status=200 body={"value": {"capabilities": {"acceptInsecureCerts": false, "browserName": "chrome", "browser...authn:extension:prf": true, "webauthn:virtualAuthenticators": true}, "sessionId": "fb2b384571be05ef97c00c7f635004f8"}}>
error_code = 'invalid argument', data = None

    def assert_error(response, error_code, data=None):
        """
        Verify that the provided webdriver.Response instance described
        a valid error response as defined by `dfn-send-an-error` and
        the provided error code.
    
        :param response: ``webdriver.Response`` instance.
        :param error_code: String value of the expected error code
        :param data: Optional dictionary containing additional information about the error.
        """
>       assert response.status == errors[error_code]
E       assert 200 == 400
E        +  where 200 = <Response: status=200 body={"value": {"capabilities": {"acceptInsecureCerts": false, "browserName": "chrome", "browserVersion": "145.0.7572.2", "chrome": {"chromedriverVersion": "145.0.7572.2 (68918169e6422bcf7c8ca8cdea509443a35f96a4-refs/branch-heads/7572@{#6})", "userDataDir": "/tmp/org.chromium.Chromium.scoped_dir.ZamEqX"}, "fedcm:accounts": true, "goog:processID": 8142, "networkConnectionEnabled": false, "pageLoadStrategy": "normal", "platformName": "linux", "proxy": {}, "setWindowRect": true, "strictFileInteractability": false, "timeouts": {"implicit": 0, "pageLoad": 300000, "script": 30000}, "unhandledPromptBehavior": {"beforeunload": "bar"}, "webauthn:extension:credBlob": true, "webauthn:extension:largeBlob": true, "webauthn:extension:minPinLength": true, "webauthn:extension:prf": true, "webauthn:virtualAuthenticators": true}, "sessionId": "fb2b384571be05ef97c00c7f635004f8"}}>.status

data       = None
error_code = 'invalid argument'
response   = <Response: status=200 body={"value": {"capabilities": {"acceptInsecureCerts": false, "browserName": "chrome", "browserVersion": "145.0.7572.2", "chrome": {"chromedriverVersion": "145.0.7572.2 (68918169e6422bcf7c8ca8cdea509443a35f96a4-refs/branch-heads/7572@{#6})", "userDataDir": "/tmp/org.chromium.Chromium.scoped_dir.ZamEqX"}, "fedcm:accounts": true, "goog:processID": 8142, "networkConnectionEnabled": false, "pageLoadStrategy": "normal", "platformName": "linux", "proxy": {}, "setWindowRect": true, "strictFileInteractability": false, "timeouts": {"implicit": 0, "pageLoad": 300000, "script": 30000}, "unhandledPromptBehavior": {"beforeunload": "bar"}, "webauthn:extension:credBlob": true, "webauthn:extension:largeBlob": true, "webauthn:extension:minPinLength": true, "webauthn:extension:prf": true, "webauthn:virtualAuthenticators": true}, "sessionId": "fb2b384571be05ef97c00c7f635004f8"}}>

webdriver/tests/support/asserts.py:51: AssertionError
  FAIL test_invalid_values[unhandledPromptBehavior-value76-<lambda>1] - assert 200 == 400
new_session = <function fixture_new_session.<locals>.new_session at 0x7f1ab5123520>
add_browser_capabilities = <function fixture_add_browser_capabilities.<locals>.add_browser_capabilities at 0x7f1ab5122d40>
body = <function <lambda> at 0x7f1ab5263b50>, key = 'unhandledPromptBehavior'
value = {'beforeunload': 'bar'}

    @pytest.mark.parametrize("body", [lambda key, value: {"alwaysMatch": {key: value}},
                                      lambda key, value: {"firstMatch": [{key: value}]}])
    @pytest.mark.parametrize("key,value", flatten(product(*item) for item in invalid_data))
    def test_invalid_values(new_session, add_browser_capabilities, body, key, value):
        capabilities = body(key, value)
        if "alwaysMatch" in capabilities:
            capabilities["alwaysMatch"] = add_browser_capabilities(capabilities["alwaysMatch"])
        else:
            capabilities["firstMatch"][0] = add_browser_capabilities(capabilities["firstMatch"][0])
    
        response, _ = new_session({"capabilities": capabilities})
>       assert_error(response, "invalid argument")

_          = {'capabilities': {'acceptInsecureCerts': False,
                  'browserName': 'chrome',
                  'browserVersion': '145.0.7572.2',
                  'chrome': {'chromedriverVersion': '145.0.7572.2 '
                                                    '(68918169e6422bcf7c8ca8cdea509443a35f96a4-refs/branch-heads/7572@{#6})',
                             'userDataDir': '/tmp/org.chromium.Chromium.scoped_dir.0FnvyY'},
                  'fedcm:accounts': True,
                  'goog:processID': 8244,
                  'networkConnectionEnabled': False,
                  'pageLoadStrategy': 'normal',
                  'platformName': 'linux',
                  'proxy': {},
                  'setWindowRect': True,
                  'strictFileInteractability': False,
                  'timeouts': {'implicit': 0,
                               'pageLoad': 300000,
                               'script': 30000},
                  'unhandledPromptBehavior': {'beforeunload': 'bar'},
                  'webauthn:extension:credBlob': True,
                  'webauthn:extension:largeBlob': True,
                  'webauthn:extension:minPinLength': True,
                  'webauthn:extension:prf': True,
                  'webauthn:virtualAuthenticators': True},
 'sessionId': 'f2e9fd69b3f3f047b6f5a8607b7e9b2d',
 'transport': <webdriver.transport.HTTPWireProtocol object at 0x7f1ab5036260>}
add_browser_capabilities = <function fixture_add_browser_capabilities.<locals>.add_browser_capabilities at 0x7f1ab5122d40>
body       = <function <lambda> at 0x7f1ab5263b50>
capabilities = {'firstMatch': [{'goog:chromeOptions': {'args': ['--ignore-certificate-errors-spki-list=vYsQ8w5o6Yfho/7w85Y60sZLhunikl3gXhU3TQz328Q=,0Rt4mT6SJXojEMHTnKnlJ/hBKMBcI4kteBlhR1eTTdk=',
                                                 '--autoplay-policy=no-user-gesture-required',
                                                 '--use-fake-device-for-media-stream',
                                                 '--use-fake-ui-for-media-stream',
                                                 '--use-fake-ui-for-fedcm',
                                                 '--enable-features=FedCmWithoutWellKnownEnforcement',
                                                 '--use-fake-ui-for-digital-identity',
                                                 '--short-reporting-delay',
                                                 '--host-resolver-rules=MAP '
                                                 'nonexistent.*.test '
                                                 '^NOTFOUND, MAP *.test '
                                                 '127.0.0.1, MAP *.test. '
                                                 '127.0.0.1',
                                                 '--enable-features=SecurePaymentConfirmationBrowser',
                                                 '--webtransport-developer-mode',
                                                 '--enable-features=GenericSensorExtraClasses',
                                                 '--disable-infobars',
                                                 '--enable-features=WebMachineLearningNeuralNetwork',
                                                 '--enable-features=InstallOnDeviceSpeechRecognition,OnDeviceWebSpeechAvailable,OnDeviceWebSpeech,MediaStreamTrackWebSpeech,WebSpeechRecognitionContext',
                                                 '--enable-unsafe-extension-debugging',
                                                 '--remote-debugging-pipe',
                                                 '--ip-address-space-overrides=127.0.0.1:8002=local,127.0.0.1:8003=public,127.0.0.1:8445=local,127.0.0.1:8446=public',
                                                 '--disable-features=ScrollbarAnimations',
                                                 '--enable-blink-features=ViewTransitionLongCallbackTimeoutForTesting,NoFontAntialiasing,MojoJS,MojoJSTest',
                                                 '--use-gl=angle',
                                                 '--use-angle=swiftshader',
                                                 '--enable-unsafe-swiftshader',
                                                 '--no-sandbox',
                                                 '--enable-experimental-web-platform-features'],
                                        'binary': '/home/test/web-platform-tests/_venv3/browsers/dev/chrome-linux64/chrome',
                                        'excludeSwitches': ['enable-automation'],
                                        'prefs': {'profile': {'default_content_setting_values': {'popups': 1}}},
                                        'w3c': True},
                 'unhandledPromptBehavior': {'beforeunload': 'bar'}}]}
key        = 'unhandledPromptBehavior'
new_session = <function fixture_new_session.<locals>.new_session at 0x7f1ab5123520>
response   = <Response: status=200 body={"value": {"capabilities": {"acceptInsecureCerts": false, "browserName": "chrome", "browserVersion": "145.0.7572.2", "chrome": {"chromedriverVersion": "145.0.7572.2 (68918169e6422bcf7c8ca8cdea509443a35f96a4-refs/branch-heads/7572@{#6})", "userDataDir": "/tmp/org.chromium.Chromium.scoped_dir.0FnvyY"}, "fedcm:accounts": true, "goog:processID": 8244, "networkConnectionEnabled": false, "pageLoadStrategy": "normal", "platformName": "linux", "proxy": {}, "setWindowRect": true, "strictFileInteractability": false, "timeouts": {"implicit": 0, "pageLoad": 300000, "script": 30000}, "unhandledPromptBehavior": {"beforeunload": "bar"}, "webauthn:extension:credBlob": true, "webauthn:extension:largeBlob": true, "webauthn:extension:minPinLength": true, "webauthn:extension:prf": true, "webauthn:virtualAuthenticators": true}, "sessionId": "f2e9fd69b3f3f047b6f5a8607b7e9b2d"}}>
value      = {'beforeunload': 'bar'}

webdriver/tests/classic/new_session/invalid_capabilities.py:42: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

response = <Response: status=200 body={"value": {"capabilities": {"acceptInsecureCerts": false, "browserName": "chrome", "browser...authn:extension:prf": true, "webauthn:virtualAuthenticators": true}, "sessionId": "f2e9fd69b3f3f047b6f5a8607b7e9b2d"}}>
error_code = 'invalid argument', data = None

    def assert_error(response, error_code, data=None):
        """
        Verify that the provided webdriver.Response instance described
        a valid error response as defined by `dfn-send-an-error` and
        the provided error code.
    
        :param response: ``webdriver.Response`` instance.
        :param error_code: String value of the expected error code
        :param data: Optional dictionary containing additional information about the error.
        """
>       assert response.status == errors[error_code]
E       assert 200 == 400
E        +  where 200 = <Response: status=200 body={"value": {"capabilities": {"acceptInsecureCerts": false, "browserName": "chrome", "browserVersion": "145.0.7572.2", "chrome": {"chromedriverVersion": "145.0.7572.2 (68918169e6422bcf7c8ca8cdea509443a35f96a4-refs/branch-heads/7572@{#6})", "userDataDir": "/tmp/org.chromium.Chromium.scoped_dir.0FnvyY"}, "fedcm:accounts": true, "goog:processID": 8244, "networkConnectionEnabled": false, "pageLoadStrategy": "normal", "platformName": "linux", "proxy": {}, "setWindowRect": true, "strictFileInteractability": false, "timeouts": {"implicit": 0, "pageLoad": 300000, "script": 30000}, "unhandledPromptBehavior": {"beforeunload": "bar"}, "webauthn:extension:credBlob": true, "webauthn:extension:largeBlob": true, "webauthn:extension:minPinLength": true, "webauthn:extension:prf": true, "webauthn:virtualAuthenticators": true}, "sessionId": "f2e9fd69b3f3f047b6f5a8607b7e9b2d"}}>.status

data       = None
error_code = 'invalid argument'
response   = <Response: status=200 body={"value": {"capabilities": {"acceptInsecureCerts": false, "browserName": "chrome", "browserVersion": "145.0.7572.2", "chrome": {"chromedriverVersion": "145.0.7572.2 (68918169e6422bcf7c8ca8cdea509443a35f96a4-refs/branch-heads/7572@{#6})", "userDataDir": "/tmp/org.chromium.Chromium.scoped_dir.0FnvyY"}, "fedcm:accounts": true, "goog:processID": 8244, "networkConnectionEnabled": false, "pageLoadStrategy": "normal", "platformName": "linux", "proxy": {}, "setWindowRect": true, "strictFileInteractability": false, "timeouts": {"implicit": 0, "pageLoad": 300000, "script": 30000}, "unhandledPromptBehavior": {"beforeunload": "bar"}, "webauthn:extension:credBlob": true, "webauthn:extension:largeBlob": true, "webauthn:extension:minPinLength": true, "webauthn:extension:prf": true, "webauthn:virtualAuthenticators": true}, "sessionId": "f2e9fd69b3f3f047b6f5a8607b7e9b2d"}}>

webdriver/tests/support/asserts.py:51: AssertionError
/webdriver/tests/classic/new_session/response.py
  FAIL test_capability_user_agent - AssertionError: assert 'userAgent' in {'acceptInsecureCerts': False, 'browserName': 'chrome', 'browserVersion': '145.0.7572.2', 'chrome': {'chromedriverVersion': '145.0.7572.2 (68918169e6422bcf7c8ca8cdea509443a35f96a4-refs/branch-heads/7572@{#6})', 'userDataDir': '/tmp/org.chromium.Chromium.scoped_dir.65uWp0'}, ...}
session = <Session 19f76365a2b006033d312499b56e0829>

    def test_capability_user_agent(session):
        assert isinstance(session.capabilities, dict)
>       assert "userAgent" in session.capabilities
E       AssertionError: assert 'userAgent' in {'acceptInsecureCerts': False, 'browserName': 'chrome', 'browserVersion': '145.0.7572.2', 'chrome': {'chromedriverVersion': '145.0.7572.2 (68918169e6422bcf7c8ca8cdea509443a35f96a4-refs/branch-heads/7572@{#6})', 'userDataDir': '/tmp/org.chromium.Chromium.scoped_dir.65uWp0'}, ...}
E        +  where {'acceptInsecureCerts': False, 'browserName': 'chrome', 'browserVersion': '145.0.7572.2', 'chrome': {'chromedriverVersion': '145.0.7572.2 (68918169e6422bcf7c8ca8cdea509443a35f96a4-refs/branch-heads/7572@{#6})', 'userDataDir': '/tmp/org.chromium.Chromium.scoped_dir.65uWp0'}, ...} = <Session 19f76365a2b006033d312499b56e0829>.capabilities

session    = <Session 19f76365a2b006033d312499b56e0829>

webdriver/tests/classic/new_session/response.py:49: AssertionError
 1:22.90 INFO Got 3 unexpected results, with 0 unexpected passes
 1:22.90 wptserve INFO Stopped http server on 127.0.0.1:8000
 1:22.91 wptserve INFO Stopped http server on 127.0.0.1:8001
 1:22.91 wptserve INFO Stopped http server on 127.0.0.1:8002
 1:22.91 wptserve INFO Stopped http server on 127.0.0.1:8003
 1:22.91 wptserve INFO Stopped http server on 127.0.0.1:8443
 1:22.91 wptserve INFO Stopped http server on 127.0.0.1:8444
 1:22.91 wptserve INFO Stopped http server on 127.0.0.1:8445
 1:22.92 wptserve INFO Stopped http server on 127.0.0.1:8446
 1:22.92 wptserve INFO Stopped http server on 127.0.0.1:9000
 1:22.93 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
 1:23.02 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 1:23.03 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 1:23.06 INFO Removed font: Ahem.ttf
 1:23.08 INFO Closing logging queue
 1:23.08 INFO queue closed
 1:23.08 INFO Tolerating 3 unexpected results
[taskcluster 2026-01-05 11:12:27.405Z] === Task Finished ===
[taskcluster 2026-01-05 11:12:28.404Z] Successful task run with exit code: 0 completed in 160.48 seconds