Skip to content

webdriver: Fix outdated timeouts test and remove redundant check #56959

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
servo-wpt-sync merged 6 commits into from
Jan 5, 2026
+29 −15

Update neglected tests

9bee018
Select commit
Loading
Failed to load commit list.
Merged

webdriver: Fix outdated timeouts test and remove redundant check #56959

Update neglected tests
9bee018
Select commit
Loading
Failed to load commit list.
Community-TC Integration / wpt-firefox-nightly-results succeeded Jan 5, 2026 in 6m 4s

Community-TC (pull_request)

Collect results for all tests affected by a pull request in firefox.

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2026-01-05T11:10:37.597Z
Resolved: 2026-01-05T11:15:40.011Z
Task Execution Time: 5 minutes, 2 seconds, 414 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md
- public/results/wpt_report.json.gz
- public/results/wpt_screenshot.txt.gz

WPT Command: python3 ./wpt run --channel=nightly --no-fail-on-unexpected --log-wptreport=../artifacts/wpt_report.json --log-wptscreenshot=../artifacts/wpt_screenshot.txt --affected base_head --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --verify-log-full --no-headless --binary=/home/test/build/firefox/firefox firefox

[taskcluster 2026-01-05 11:10:37.710Z] Task ID: E96boH6FRDCMpeeFUTT-KA
[taskcluster 2026-01-05 11:10:37.710Z] Worker ID: 2115300902791685582
[taskcluster 2026-01-05 11:10:37.710Z] Worker Group: us-central1-a
[taskcluster 2026-01-05 11:10:37.710Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2026-01-05 11:10:37.710Z] Worker Pool: proj-wpt/ci
[taskcluster 2026-01-05 11:10:37.710Z] Worker Version: 46.1.0
[taskcluster 2026-01-05 11:10:37.710Z] Public IP: 34.61.52.185
[taskcluster 2026-01-05 11:10:37.710Z] Hostname: proj-wpt-ci-njlsgxt0t6-gz5p-ljaq5q

[taskcluster 2026-01-05 11:10:38.482Z] === Task Starting ===
+ '[' '' ']'
+ '[' -d /etc/profile.d ']'
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/01-locale-fix.sh ']'
+ . /etc/profile.d/01-locale-fix.sh
+++ /usr/bin/locale-check C.UTF-8
++ eval
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/apps-bin-path.sh ']'
+ . /etc/profile.d/apps-bin-path.sh

...(4043 lines hidden)...

                  'pageLoadStrategy': 'normal',
                  'platformName': 'linux',
                  'proxy': {},
                  'setWindowRect': True,
                  'strictFileInteractability': False,
                  'timeouts': {'implicit': 0,
                               'pageLoad': 300000,
                               'script': None},
                  'unhandledPromptBehavior': 'dismiss and notify',
                  'userAgent': 'Mozilla/5.0 (X11; Linux x86_64; rv:148.0) '
                               'Gecko/20100101 Firefox/148.0'},
 'sessionId': '9713d44d-55ef-418d-8d7d-c8e47fce4829'}

webdriver/tests/classic/new_session/timeouts.py:21: AssertionError
  FAIL test_timeouts[script-0] - AssertionError: assert {'implicit': 0, 'pageLoad': 300000, 'script': 0} == {'script': 0}
new_session = <function fixture_new_session.<locals>.new_session at 0x7fe12520aa70>
add_browser_capabilities = <function fixture_add_browser_capabilities.<locals>.add_browser_capabilities at 0x7fe12520b9a0>
key = 'script'
value = {'capabilities': {'acceptInsecureCerts': False, 'browserName': 'firefox', 'browserVersion': '148.0a1', 'moz:accessibilityChecks': False, ...}, 'sessionId': '833f55c4-6706-466f-8343-8c43f2f83854'}

    @pytest.mark.parametrize("value", [None, 0, 3000])
    @pytest.mark.parametrize("key", ["implicit", "pageLoad", "script"])
    def test_timeouts(new_session, add_browser_capabilities, key, value):
        timeouts = {key: value}
        response, _ = new_session({"capabilities": {"alwaysMatch": add_browser_capabilities({"timeouts": timeouts})}})
        value = assert_success(response)
>       assert value["capabilities"]["timeouts"] == timeouts
E       AssertionError: assert {'implicit': 0, 'pageLoad': 300000, 'script': 0} == {'script': 0}
E         
E         Common items:
E         {'script': 0}
E         Left contains 2 more items:
E         {'implicit': 0, 'pageLoad': 300000}
E         
E         Full diff:
E           {
E         +     'implicit': 0,
E         +     'pageLoad': 300000,
E               'script': 0,
E           }

_          = {'capabilities': {'acceptInsecureCerts': False,
                  'browserName': 'firefox',
                  'browserVersion': '148.0a1',
                  'moz:accessibilityChecks': False,
                  'moz:buildID': '20260104092619',
                  'moz:geckodriverVersion': '0.36.0',
                  'moz:headless': False,
                  'moz:platformVersion': '5.15.0-1025-gcp',
                  'moz:processID': 15737,
                  'moz:profile': '/tmp/tmp2uxq0jc3.mozrunner',
                  'moz:shutdownTimeout': 60000,
                  'moz:webdriverClick': True,
                  'moz:windowless': False,
                  'pageLoadStrategy': 'normal',
                  'platformName': 'linux',
                  'proxy': {},
                  'setWindowRect': True,
                  'strictFileInteractability': False,
                  'timeouts': {'implicit': 0, 'pageLoad': 300000, 'script': 0},
                  'unhandledPromptBehavior': 'dismiss and notify',
                  'userAgent': 'Mozilla/5.0 (X11; Linux x86_64; rv:148.0) '
                               'Gecko/20100101 Firefox/148.0'},
 'sessionId': '833f55c4-6706-466f-8343-8c43f2f83854',
 'transport': <webdriver.transport.HTTPWireProtocol object at 0x7fe12535fe80>}
add_browser_capabilities = <function fixture_add_browser_capabilities.<locals>.add_browser_capabilities at 0x7fe12520b9a0>
key        = 'script'
new_session = <function fixture_new_session.<locals>.new_session at 0x7fe12520aa70>
response   = <Response: status=200 body={"value": {"sessionId": "833f55c4-6706-466f-8343-8c43f2f83854", "capabilities": {"acceptInsecureCerts": false, "browserName": "firefox", "browserVersion": "148.0a1", "moz:accessibilityChecks": false, "moz:buildID": "20260104092619", "moz:geckodriverVersion": "0.36.0", "moz:headless": false, "moz:platformVersion": "5.15.0-1025-gcp", "moz:processID": 15737, "moz:profile": "/tmp/tmp2uxq0jc3.mozrunner", "moz:shutdownTimeout": 60000, "moz:webdriverClick": true, "moz:windowless": false, "pageLoadStrategy": "normal", "platformName": "linux", "proxy": {}, "setWindowRect": true, "strictFileInteractability": false, "timeouts": {"implicit": 0, "pageLoad": 300000, "script": 0}, "unhandledPromptBehavior": "dismiss and notify", "userAgent": "Mozilla/5.0 (X11; Linux x86_64; rv:148.0) Gecko/20100101 Firefox/148.0"}}}>
timeouts   = {'script': 0}
value      = {'capabilities': {'acceptInsecureCerts': False,
                  'browserName': 'firefox',
                  'browserVersion': '148.0a1',
                  'moz:accessibilityChecks': False,
                  'moz:buildID': '20260104092619',
                  'moz:geckodriverVersion': '0.36.0',
                  'moz:headless': False,
                  'moz:platformVersion': '5.15.0-1025-gcp',
                  'moz:processID': 15737,
                  'moz:profile': '/tmp/tmp2uxq0jc3.mozrunner',
                  'moz:shutdownTimeout': 60000,
                  'moz:webdriverClick': True,
                  'moz:windowless': False,
                  'pageLoadStrategy': 'normal',
                  'platformName': 'linux',
                  'proxy': {},
                  'setWindowRect': True,
                  'strictFileInteractability': False,
                  'timeouts': {'implicit': 0, 'pageLoad': 300000, 'script': 0},
                  'unhandledPromptBehavior': 'dismiss and notify',
                  'userAgent': 'Mozilla/5.0 (X11; Linux x86_64; rv:148.0) '
                               'Gecko/20100101 Firefox/148.0'},
 'sessionId': '833f55c4-6706-466f-8343-8c43f2f83854'}

webdriver/tests/classic/new_session/timeouts.py:21: AssertionError
  FAIL test_timeouts[script-3000] - AssertionError: assert {'implicit': 0, 'pageLoad': 300000, 'script': 3000} == {'script': 3000}
new_session = <function fixture_new_session.<locals>.new_session at 0x7fe12520bac0>
add_browser_capabilities = <function fixture_add_browser_capabilities.<locals>.add_browser_capabilities at 0x7fe12520ba30>
key = 'script'
value = {'capabilities': {'acceptInsecureCerts': False, 'browserName': 'firefox', 'browserVersion': '148.0a1', 'moz:accessibilityChecks': False, ...}, 'sessionId': '5d794c4e-2b9b-4f9c-b9af-5f43ff2428bc'}

    @pytest.mark.parametrize("value", [None, 0, 3000])
    @pytest.mark.parametrize("key", ["implicit", "pageLoad", "script"])
    def test_timeouts(new_session, add_browser_capabilities, key, value):
        timeouts = {key: value}
        response, _ = new_session({"capabilities": {"alwaysMatch": add_browser_capabilities({"timeouts": timeouts})}})
        value = assert_success(response)
>       assert value["capabilities"]["timeouts"] == timeouts
E       AssertionError: assert {'implicit': 0, 'pageLoad': 300000, 'script': 3000} == {'script': 3000}
E         
E         Common items:
E         {'script': 3000}
E         Left contains 2 more items:
E         {'implicit': 0, 'pageLoad': 300000}
E         
E         Full diff:
E           {
E         +     'implicit': 0,
E         +     'pageLoad': 300000,
E               'script': 3000,
E           }

_          = {'capabilities': {'acceptInsecureCerts': False,
                  'browserName': 'firefox',
                  'browserVersion': '148.0a1',
                  'moz:accessibilityChecks': False,
                  'moz:buildID': '20260104092619',
                  'moz:geckodriverVersion': '0.36.0',
                  'moz:headless': False,
                  'moz:platformVersion': '5.15.0-1025-gcp',
                  'moz:processID': 15944,
                  'moz:profile': '/tmp/tmp2uxq0jc3.mozrunner',
                  'moz:shutdownTimeout': 60000,
                  'moz:webdriverClick': True,
                  'moz:windowless': False,
                  'pageLoadStrategy': 'normal',
                  'platformName': 'linux',
                  'proxy': {},
                  'setWindowRect': True,
                  'strictFileInteractability': False,
                  'timeouts': {'implicit': 0,
                               'pageLoad': 300000,
                               'script': 3000},
                  'unhandledPromptBehavior': 'dismiss and notify',
                  'userAgent': 'Mozilla/5.0 (X11; Linux x86_64; rv:148.0) '
                               'Gecko/20100101 Firefox/148.0'},
 'sessionId': '5d794c4e-2b9b-4f9c-b9af-5f43ff2428bc',
 'transport': <webdriver.transport.HTTPWireProtocol object at 0x7fe1252302b0>}
add_browser_capabilities = <function fixture_add_browser_capabilities.<locals>.add_browser_capabilities at 0x7fe12520ba30>
key        = 'script'
new_session = <function fixture_new_session.<locals>.new_session at 0x7fe12520bac0>
response   = <Response: status=200 body={"value": {"sessionId": "5d794c4e-2b9b-4f9c-b9af-5f43ff2428bc", "capabilities": {"acceptInsecureCerts": false, "browserName": "firefox", "browserVersion": "148.0a1", "moz:accessibilityChecks": false, "moz:buildID": "20260104092619", "moz:geckodriverVersion": "0.36.0", "moz:headless": false, "moz:platformVersion": "5.15.0-1025-gcp", "moz:processID": 15944, "moz:profile": "/tmp/tmp2uxq0jc3.mozrunner", "moz:shutdownTimeout": 60000, "moz:webdriverClick": true, "moz:windowless": false, "pageLoadStrategy": "normal", "platformName": "linux", "proxy": {}, "setWindowRect": true, "strictFileInteractability": false, "timeouts": {"implicit": 0, "pageLoad": 300000, "script": 3000}, "unhandledPromptBehavior": "dismiss and notify", "userAgent": "Mozilla/5.0 (X11; Linux x86_64; rv:148.0) Gecko/20100101 Firefox/148.0"}}}>
timeouts   = {'script': 3000}
value      = {'capabilities': {'acceptInsecureCerts': False,
                  'browserName': 'firefox',
                  'browserVersion': '148.0a1',
                  'moz:accessibilityChecks': False,
                  'moz:buildID': '20260104092619',
                  'moz:geckodriverVersion': '0.36.0',
                  'moz:headless': False,
                  'moz:platformVersion': '5.15.0-1025-gcp',
                  'moz:processID': 15944,
                  'moz:profile': '/tmp/tmp2uxq0jc3.mozrunner',
                  'moz:shutdownTimeout': 60000,
                  'moz:webdriverClick': True,
                  'moz:windowless': False,
                  'pageLoadStrategy': 'normal',
                  'platformName': 'linux',
                  'proxy': {},
                  'setWindowRect': True,
                  'strictFileInteractability': False,
                  'timeouts': {'implicit': 0,
                               'pageLoad': 300000,
                               'script': 3000},
                  'unhandledPromptBehavior': 'dismiss and notify',
                  'userAgent': 'Mozilla/5.0 (X11; Linux x86_64; rv:148.0) '
                               'Gecko/20100101 Firefox/148.0'},
 'sessionId': '5d794c4e-2b9b-4f9c-b9af-5f43ff2428bc'}

webdriver/tests/classic/new_session/timeouts.py:21: AssertionError
 3:52.91 INFO Got 1 unexpected results, with 0 unexpected passes
 3:52.91 wptserve INFO Stopped http server on 127.0.0.1:8000
 3:52.91 wptserve INFO Stopped http server on 127.0.0.1:8001
 3:52.92 wptserve INFO Stopped http server on 127.0.0.1:8002
 3:52.92 wptserve INFO Stopped http server on 127.0.0.1:8443
 3:52.92 wptserve INFO Stopped http server on 127.0.0.1:8444
 3:52.92 wptserve INFO Stopped http server on 127.0.0.1:8445
 3:52.92 wptserve INFO Stopped http server on 127.0.0.1:8003
 3:52.93 wptserve INFO Stopped http server on 127.0.0.1:8446
 3:52.94 wptserve INFO Stopped http server on 127.0.0.1:9000
 3:52.94 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
 3:53.38 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 3:53.38 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 3:53.43 INFO Removed font: Ahem.ttf
 3:53.46 INFO Closing logging queue
 3:53.46 INFO queue closed
 3:53.46 INFO Tolerating 1 unexpected results
[taskcluster 2026-01-05 11:15:38.189Z] === Task Finished ===
[taskcluster 2026-01-05 11:15:39.153Z] Successful task run with exit code: 0 completed in 301.444 seconds
View more details on Community-TC Integration