Skip to content

Update neglected tests

9bee018
Select commit
Loading
Failed to load commit list.
Merged

webdriver: Fix outdated timeouts test and remove redundant check #56959

Update neglected tests
9bee018
Select commit
Loading
Failed to load commit list.
Community-TC Integration / wpt-chrome-dev-results succeeded Jan 5, 2026 in 6m 26s

Community-TC (pull_request)

Collect results for all tests affected by a pull request in chrome.

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2026-01-05T11:09:46.865Z
Resolved: 2026-01-05T11:16:03.261Z
Task Execution Time: 6 minutes, 16 seconds, 396 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md
- public/results/wpt_report.json.gz
- public/results/wpt_screenshot.txt.gz

WPT Command: python3 ./wpt run --channel=dev --no-fail-on-unexpected --log-wptreport=../artifacts/wpt_report.json --log-wptscreenshot=../artifacts/wpt_screenshot.txt --affected base_head --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --verify-log-full --no-headless --enable-swiftshader --install-browser --install-webdriver chrome


[taskcluster 2026-01-05 11:09:46.939Z] Task ID: SOkBp8-GQEGSkBHtMp-vfw
[taskcluster 2026-01-05 11:09:46.939Z] Worker ID: 3964719820518597764
[taskcluster 2026-01-05 11:09:46.939Z] Worker Group: us-central1-a
[taskcluster 2026-01-05 11:09:46.939Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2026-01-05 11:09:46.939Z] Worker Pool: proj-wpt/ci
[taskcluster 2026-01-05 11:09:46.939Z] Worker Version: 46.1.0
[taskcluster 2026-01-05 11:09:46.939Z] Public IP: 34.72.5.69
[taskcluster 2026-01-05 11:09:46.939Z] Hostname: proj-wpt-ci-mhm0-jtgqx6am1eie79udg

[taskcluster 2026-01-05 11:09:47.968Z] === Task Starting ===
+ '[' '' ']'
+ '[' -d /etc/profile.d ']'
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/01-locale-fix.sh ']'
+ . /etc/profile.d/01-locale-fix.sh
+++ /usr/bin/locale-check C.UTF-8
++ eval
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/apps-bin-path.sh ']'
+ . /etc/profile.d/apps-bin-path.sh

...(5753 lines hidden)...

                  'networkConnectionEnabled': False,
                  'pageLoadStrategy': 'normal',
                  'platformName': 'linux',
                  'proxy': {},
                  'setWindowRect': True,
                  'strictFileInteractability': False,
                  'timeouts': {'implicit': 0,
                               'pageLoad': 300000,
                               'script': None},
                  'unhandledPromptBehavior': 'dismiss and notify',
                  'webauthn:extension:credBlob': True,
                  'webauthn:extension:largeBlob': True,
                  'webauthn:extension:minPinLength': True,
                  'webauthn:extension:prf': True,
                  'webauthn:virtualAuthenticators': True},
 'sessionId': '5c04311c12c16aae437d7dc3607b8dc5'}

webdriver/tests/classic/new_session/timeouts.py:21: AssertionError
  FAIL test_timeouts[script-0] - AssertionError: assert {'implicit': 0, 'pageLoad': 300000, 'script': 0} == {'script': 0}
new_session = <function fixture_new_session.<locals>.new_session at 0x7fb6e0af1870>
add_browser_capabilities = <function fixture_add_browser_capabilities.<locals>.add_browser_capabilities at 0x7fb6e0af17e0>
key = 'script'
value = {'capabilities': {'acceptInsecureCerts': False, 'browserName': 'chrome', 'browserVersion': '145.0.7572.2', 'chrome': {... 'userDataDir': '/tmp/org.chromium.Chromium.scoped_dir.zCNpVg'}, ...}, 'sessionId': '1e0cde8e5c5f63f1842c60b0d5721154'}

    @pytest.mark.parametrize("value", [None, 0, 3000])
    @pytest.mark.parametrize("key", ["implicit", "pageLoad", "script"])
    def test_timeouts(new_session, add_browser_capabilities, key, value):
        timeouts = {key: value}
        response, _ = new_session({"capabilities": {"alwaysMatch": add_browser_capabilities({"timeouts": timeouts})}})
        value = assert_success(response)
>       assert value["capabilities"]["timeouts"] == timeouts
E       AssertionError: assert {'implicit': 0, 'pageLoad': 300000, 'script': 0} == {'script': 0}
E         
E         Common items:
E         {'script': 0}
E         Left contains 2 more items:
E         {'implicit': 0, 'pageLoad': 300000}
E         
E         Full diff:
E           {
E         +     'implicit': 0,
E         +     'pageLoad': 300000,
E               'script': 0,
E           }

_          = {'capabilities': {'acceptInsecureCerts': False,
                  'browserName': 'chrome',
                  'browserVersion': '145.0.7572.2',
                  'chrome': {'chromedriverVersion': '145.0.7572.2 '
                                                    '(68918169e6422bcf7c8ca8cdea509443a35f96a4-refs/branch-heads/7572@{#6})',
                             'userDataDir': '/tmp/org.chromium.Chromium.scoped_dir.zCNpVg'},
                  'fedcm:accounts': True,
                  'goog:processID': 9940,
                  'networkConnectionEnabled': False,
                  'pageLoadStrategy': 'normal',
                  'platformName': 'linux',
                  'proxy': {},
                  'setWindowRect': True,
                  'strictFileInteractability': False,
                  'timeouts': {'implicit': 0, 'pageLoad': 300000, 'script': 0},
                  'unhandledPromptBehavior': 'dismiss and notify',
                  'webauthn:extension:credBlob': True,
                  'webauthn:extension:largeBlob': True,
                  'webauthn:extension:minPinLength': True,
                  'webauthn:extension:prf': True,
                  'webauthn:virtualAuthenticators': True},
 'sessionId': '1e0cde8e5c5f63f1842c60b0d5721154',
 'transport': <webdriver.transport.HTTPWireProtocol object at 0x7fb6e0acd0c0>}
add_browser_capabilities = <function fixture_add_browser_capabilities.<locals>.add_browser_capabilities at 0x7fb6e0af17e0>
key        = 'script'
new_session = <function fixture_new_session.<locals>.new_session at 0x7fb6e0af1870>
response   = <Response: status=200 body={"value": {"capabilities": {"acceptInsecureCerts": false, "browserName": "chrome", "browserVersion": "145.0.7572.2", "chrome": {"chromedriverVersion": "145.0.7572.2 (68918169e6422bcf7c8ca8cdea509443a35f96a4-refs/branch-heads/7572@{#6})", "userDataDir": "/tmp/org.chromium.Chromium.scoped_dir.zCNpVg"}, "fedcm:accounts": true, "goog:processID": 9940, "networkConnectionEnabled": false, "pageLoadStrategy": "normal", "platformName": "linux", "proxy": {}, "setWindowRect": true, "strictFileInteractability": false, "timeouts": {"implicit": 0, "pageLoad": 300000, "script": 0}, "unhandledPromptBehavior": "dismiss and notify", "webauthn:extension:credBlob": true, "webauthn:extension:largeBlob": true, "webauthn:extension:minPinLength": true, "webauthn:extension:prf": true, "webauthn:virtualAuthenticators": true}, "sessionId": "1e0cde8e5c5f63f1842c60b0d5721154"}}>
timeouts   = {'script': 0}
value      = {'capabilities': {'acceptInsecureCerts': False,
                  'browserName': 'chrome',
                  'browserVersion': '145.0.7572.2',
                  'chrome': {'chromedriverVersion': '145.0.7572.2 '
                                                    '(68918169e6422bcf7c8ca8cdea509443a35f96a4-refs/branch-heads/7572@{#6})',
                             'userDataDir': '/tmp/org.chromium.Chromium.scoped_dir.zCNpVg'},
                  'fedcm:accounts': True,
                  'goog:processID': 9940,
                  'networkConnectionEnabled': False,
                  'pageLoadStrategy': 'normal',
                  'platformName': 'linux',
                  'proxy': {},
                  'setWindowRect': True,
                  'strictFileInteractability': False,
                  'timeouts': {'implicit': 0, 'pageLoad': 300000, 'script': 0},
                  'unhandledPromptBehavior': 'dismiss and notify',
                  'webauthn:extension:credBlob': True,
                  'webauthn:extension:largeBlob': True,
                  'webauthn:extension:minPinLength': True,
                  'webauthn:extension:prf': True,
                  'webauthn:virtualAuthenticators': True},
 'sessionId': '1e0cde8e5c5f63f1842c60b0d5721154'}

webdriver/tests/classic/new_session/timeouts.py:21: AssertionError
  FAIL test_timeouts[script-3000] - AssertionError: assert {'implicit': 0, 'pageLoad': 300000, 'script': 3000} == {'script': 3000}
new_session = <function fixture_new_session.<locals>.new_session at 0x7fb6e0af0a60>
add_browser_capabilities = <function fixture_add_browser_capabilities.<locals>.add_browser_capabilities at 0x7fb6e0af0940>
key = 'script'
value = {'capabilities': {'acceptInsecureCerts': False, 'browserName': 'chrome', 'browserVersion': '145.0.7572.2', 'chrome': {... 'userDataDir': '/tmp/org.chromium.Chromium.scoped_dir.aN80hT'}, ...}, 'sessionId': '770fca7f4858d9dfb893329eccdfd19e'}

    @pytest.mark.parametrize("value", [None, 0, 3000])
    @pytest.mark.parametrize("key", ["implicit", "pageLoad", "script"])
    def test_timeouts(new_session, add_browser_capabilities, key, value):
        timeouts = {key: value}
        response, _ = new_session({"capabilities": {"alwaysMatch": add_browser_capabilities({"timeouts": timeouts})}})
        value = assert_success(response)
>       assert value["capabilities"]["timeouts"] == timeouts
E       AssertionError: assert {'implicit': 0, 'pageLoad': 300000, 'script': 3000} == {'script': 3000}
E         
E         Common items:
E         {'script': 3000}
E         Left contains 2 more items:
E         {'implicit': 0, 'pageLoad': 300000}
E         
E         Full diff:
E           {
E         +     'implicit': 0,
E         +     'pageLoad': 300000,
E               'script': 3000,
E           }

_          = {'capabilities': {'acceptInsecureCerts': False,
                  'browserName': 'chrome',
                  'browserVersion': '145.0.7572.2',
                  'chrome': {'chromedriverVersion': '145.0.7572.2 '
                                                    '(68918169e6422bcf7c8ca8cdea509443a35f96a4-refs/branch-heads/7572@{#6})',
                             'userDataDir': '/tmp/org.chromium.Chromium.scoped_dir.aN80hT'},
                  'fedcm:accounts': True,
                  'goog:processID': 10043,
                  'networkConnectionEnabled': False,
                  'pageLoadStrategy': 'normal',
                  'platformName': 'linux',
                  'proxy': {},
                  'setWindowRect': True,
                  'strictFileInteractability': False,
                  'timeouts': {'implicit': 0,
                               'pageLoad': 300000,
                               'script': 3000},
                  'unhandledPromptBehavior': 'dismiss and notify',
                  'webauthn:extension:credBlob': True,
                  'webauthn:extension:largeBlob': True,
                  'webauthn:extension:minPinLength': True,
                  'webauthn:extension:prf': True,
                  'webauthn:virtualAuthenticators': True},
 'sessionId': '770fca7f4858d9dfb893329eccdfd19e',
 'transport': <webdriver.transport.HTTPWireProtocol object at 0x7fb6e0b36170>}
add_browser_capabilities = <function fixture_add_browser_capabilities.<locals>.add_browser_capabilities at 0x7fb6e0af0940>
key        = 'script'
new_session = <function fixture_new_session.<locals>.new_session at 0x7fb6e0af0a60>
response   = <Response: status=200 body={"value": {"capabilities": {"acceptInsecureCerts": false, "browserName": "chrome", "browserVersion": "145.0.7572.2", "chrome": {"chromedriverVersion": "145.0.7572.2 (68918169e6422bcf7c8ca8cdea509443a35f96a4-refs/branch-heads/7572@{#6})", "userDataDir": "/tmp/org.chromium.Chromium.scoped_dir.aN80hT"}, "fedcm:accounts": true, "goog:processID": 10043, "networkConnectionEnabled": false, "pageLoadStrategy": "normal", "platformName": "linux", "proxy": {}, "setWindowRect": true, "strictFileInteractability": false, "timeouts": {"implicit": 0, "pageLoad": 300000, "script": 3000}, "unhandledPromptBehavior": "dismiss and notify", "webauthn:extension:credBlob": true, "webauthn:extension:largeBlob": true, "webauthn:extension:minPinLength": true, "webauthn:extension:prf": true, "webauthn:virtualAuthenticators": true}, "sessionId": "770fca7f4858d9dfb893329eccdfd19e"}}>
timeouts   = {'script': 3000}
value      = {'capabilities': {'acceptInsecureCerts': False,
                  'browserName': 'chrome',
                  'browserVersion': '145.0.7572.2',
                  'chrome': {'chromedriverVersion': '145.0.7572.2 '
                                                    '(68918169e6422bcf7c8ca8cdea509443a35f96a4-refs/branch-heads/7572@{#6})',
                             'userDataDir': '/tmp/org.chromium.Chromium.scoped_dir.aN80hT'},
                  'fedcm:accounts': True,
                  'goog:processID': 10043,
                  'networkConnectionEnabled': False,
                  'pageLoadStrategy': 'normal',
                  'platformName': 'linux',
                  'proxy': {},
                  'setWindowRect': True,
                  'strictFileInteractability': False,
                  'timeouts': {'implicit': 0,
                               'pageLoad': 300000,
                               'script': 3000},
                  'unhandledPromptBehavior': 'dismiss and notify',
                  'webauthn:extension:credBlob': True,
                  'webauthn:extension:largeBlob': True,
                  'webauthn:extension:minPinLength': True,
                  'webauthn:extension:prf': True,
                  'webauthn:virtualAuthenticators': True},
 'sessionId': '770fca7f4858d9dfb893329eccdfd19e'}

webdriver/tests/classic/new_session/timeouts.py:21: AssertionError
 1:46.82 INFO Got 4 unexpected results, with 0 unexpected passes
 1:46.82 wptserve INFO Stopped http server on 127.0.0.1:8000
 1:46.82 wptserve INFO Stopped http server on 127.0.0.1:8001
 1:46.82 wptserve INFO Stopped http server on 127.0.0.1:8002
 1:46.83 wptserve INFO Stopped http server on 127.0.0.1:8003
 1:46.84 wptserve INFO Stopped http server on 127.0.0.1:8443
 1:46.84 wptserve INFO Stopped http server on 127.0.0.1:8444
 1:46.84 wptserve INFO Stopped http server on 127.0.0.1:8446
 1:46.84 wptserve INFO Stopped http server on 127.0.0.1:8445
 1:46.85 wptserve INFO Stopped http server on 127.0.0.1:9000
 1:46.85 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
 1:47.18 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 1:47.19 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 1:47.23 INFO Removed font: Ahem.ttf
 1:47.26 INFO Closing logging queue
 1:47.26 INFO queue closed
 1:47.26 INFO Tolerating 4 unexpected results
[taskcluster 2026-01-05 11:16:01.436Z] === Task Finished ===
[taskcluster 2026-01-05 11:16:02.425Z] Successful task run with exit code: 0 completed in 375.486 seconds