Skip to content

Conversation

microsoft-playwright-automation[bot]
Copy link
Contributor

@microsoft-playwright-automation microsoft-playwright-automation bot commented Sep 26, 2025

Patch which broke us: https://chromium.googlesource.com/chromium/src/+/c35065f7e612e3becbe7f24baaca28c7859b7543

Disabling the RenderDocument feature makes the test pass.

Copy link
Contributor

Test results for "tests 1"

6 failed
❌ [chromium-library] › library/chromium/js-coverage.spec.ts:66 › should report scripts across navigations when disabled @ubuntu-22.04-chromium-tip-of-tree
❌ [chromium-page] › page/frame-evaluate.spec.ts:45 › should dispose context on navigation @ubuntu-22.04-chromium-tip-of-tree
❌ [chromium-page] › page/frame-evaluate.spec.ts:55 › should dispose context on cross-origin navigation @ubuntu-22.04-chromium-tip-of-tree
❌ [chromium-page] › page/page-goto.spec.ts:828 › should return when navigation is committed if commit is specified @ubuntu-22.04-chromium-tip-of-tree
❌ [chromium-page] › page/page-wait-for-navigation.spec.ts:63 › should work with commit @ubuntu-22.04-chromium-tip-of-tree
❌ [chromium-page] › page/page-wait-for-url.spec.ts:52 › should work with commit @ubuntu-22.04-chromium-tip-of-tree

1 flaky ⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-ubuntu-22.04-node18`

46928 passed, 821 skipped


Merge workflow run.

Copy link
Contributor

Test results for "tests others"

2 fatal errors, not part of any test

1 interrupted ⚠️ [electron-page] › page/page-keyboard.spec.ts:300 › should throw on unknown keys `@electron-macos-latest`

21618 passed, 474 skipped, 860 did not run


Merge workflow run.

Copy link
Contributor

Test results for "tests 2"

2 fatal errors, not part of any test
43 failed
❌ [chromium-library] › library/browsercontext-page-event.spec.ts:160 › should work with Shift-clicking @chromium-tip-of-tree-headless-shell-ubuntu-22.04
❌ [chromium-library] › library/browsercontext-page-event.spec.ts:173 › should work with Ctrl-clicking @chromium-tip-of-tree-headless-shell-ubuntu-22.04
❌ [chromium-library] › library/chromium/js-coverage.spec.ts:66 › should report scripts across navigations when disabled @chromium-tip-of-tree-headless-shell-ubuntu-22.04
❌ [chromium-page] › page/frame-evaluate.spec.ts:45 › should dispose context on navigation @chromium-tip-of-tree-headless-shell-ubuntu-22.04
❌ [chromium-page] › page/frame-evaluate.spec.ts:55 › should dispose context on cross-origin navigation @chromium-tip-of-tree-headless-shell-ubuntu-22.04
❌ [chromium-page] › page/page-goto.spec.ts:828 › should return when navigation is committed if commit is specified @chromium-tip-of-tree-headless-shell-ubuntu-22.04
❌ [chromium-page] › page/page-wait-for-url.spec.ts:52 › should work with commit @chromium-tip-of-tree-headless-shell-ubuntu-22.04
❌ [chromium-library] › library/chromium/js-coverage.spec.ts:66 › should report scripts across navigations when disabled @chromium-tip-of-tree-ubuntu-22.04--headed
❌ [chromium-page] › page/frame-evaluate.spec.ts:45 › should dispose context on navigation @chromium-tip-of-tree-ubuntu-22.04--headed
❌ [chromium-page] › page/frame-evaluate.spec.ts:55 › should dispose context on cross-origin navigation @chromium-tip-of-tree-ubuntu-22.04--headed
❌ [chromium-page] › page/page-goto.spec.ts:828 › should return when navigation is committed if commit is specified @chromium-tip-of-tree-ubuntu-22.04--headed
❌ [chromium-page] › page/page-wait-for-navigation.spec.ts:63 › should work with commit @chromium-tip-of-tree-ubuntu-22.04--headed
❌ [chromium-page] › page/page-wait-for-url.spec.ts:52 › should work with commit @chromium-tip-of-tree-ubuntu-22.04--headed
❌ [chromium-library] › library/chromium/js-coverage.spec.ts:66 › should report scripts across navigations when disabled @chromium-tip-of-tree-windows-latest
❌ [chromium-page] › page/frame-evaluate.spec.ts:45 › should dispose context on navigation @chromium-tip-of-tree-windows-latest
❌ [chromium-page] › page/frame-evaluate.spec.ts:55 › should dispose context on cross-origin navigation @chromium-tip-of-tree-windows-latest
❌ [chromium-library] › library/chromium/js-coverage.spec.ts:66 › should report scripts across navigations when disabled @chromium-tip-of-tree-windows-latest--headed
❌ [chromium-page] › page/frame-evaluate.spec.ts:45 › should dispose context on navigation @chromium-tip-of-tree-windows-latest--headed
❌ [chromium-page] › page/frame-evaluate.spec.ts:55 › should dispose context on cross-origin navigation @chromium-tip-of-tree-windows-latest--headed
❌ [firefox-library] › library/defaultbrowsercontext-2.spec.ts:70 › should support geolocation and permissions options @firefox-beta-windows-latest
❌ [firefox-library] › library/geolocation.spec.ts:20 › should work @smoke @firefox-beta-windows-latest
❌ [firefox-library] › library/geolocation.spec.ts:46 › should isolate contexts @firefox-beta-windows-latest
❌ [firefox-library] › library/geolocation.spec.ts:112 › should use context options @firefox-beta-windows-latest
❌ [firefox-library] › library/geolocation.spec.ts:128 › watchPosition should be notified @firefox-beta-windows-latest
❌ [firefox-library] › library/geolocation.spec.ts:162 › should use context options for popup @firefox-beta-windows-latest
❌ [firefox-library] › library/defaultbrowsercontext-2.spec.ts:70 › should support geolocation and permissions options @firefox-headed-windows-latest
❌ [firefox-library] › library/geolocation.spec.ts:46 › should isolate contexts @firefox-headed-windows-latest
❌ [firefox-library] › library/geolocation.spec.ts:112 › should use context options @firefox-headed-windows-latest
❌ [firefox-library] › library/geolocation.spec.ts:128 › watchPosition should be notified @firefox-headed-windows-latest
❌ [firefox-library] › library/geolocation.spec.ts:162 › should use context options for popup @firefox-headed-windows-latest
❌ [firefox-library] › library/inspector/cli-codegen-2.spec.ts:456 › cli codegen › should save assets via SIGINT @firefox-macos-13-large
❌ [firefox-library] › library/defaultbrowsercontext-2.spec.ts:70 › should support geolocation and permissions options @firefox-windows-latest
❌ [firefox-library] › library/geolocation.spec.ts:20 › should work @smoke @firefox-windows-latest
❌ [firefox-library] › library/geolocation.spec.ts:46 › should isolate contexts @firefox-windows-latest
❌ [firefox-library] › library/geolocation.spec.ts:112 › should use context options @firefox-windows-latest
❌ [firefox-library] › library/geolocation.spec.ts:128 › watchPosition should be notified @firefox-windows-latest
❌ [firefox-library] › library/geolocation.spec.ts:162 › should use context options for popup @firefox-windows-latest
❌ [chromium-page] › page/frame-evaluate.spec.ts:45 › should dispose context on navigation @tracing-chromium-tip-of-tree
❌ [chromium-page] › page/frame-evaluate.spec.ts:55 › should dispose context on cross-origin navigation @tracing-chromium-tip-of-tree
❌ [chromium-page] › page/page-goto.spec.ts:828 › should return when navigation is committed if commit is specified @tracing-chromium-tip-of-tree
❌ [chromium-page] › page/page-wait-for-url.spec.ts:52 › should work with commit @tracing-chromium-tip-of-tree
❌ [webkit-library] › library/trace-viewer.spec.ts:1678 › canvas clipping in iframe @webkit-macos-14-xlarge
❌ [webkit-library] › library/capabilities.spec.ts:92 › should play audio @smoke @webkit-macos-15-large

95 flaky ⚠️ [chromium-library] › library/video.spec.ts:378 › screencast › should capture navigation `@channel-chromium-macos-latest`
⚠️ [chromium-page] › page/workers.spec.ts:150 › should report network activity `@channel-chromium-macos-latest`
⚠️ [chromium-library] › library/chromium/oopif.spec.ts:284 › should click `@chrome-beta-macos-latest`
⚠️ [chromium-library] › library/debug-controller.spec.ts:414 › should not work with browser._launchServer(_debugController: false) `@chrome-beta-macos-latest`
⚠️ [chromium-page] › page/page-event-popup.spec.ts:96 › should work with noopener and about:blank `@chrome-beta-macos-latest`
⚠️ [chromium-page] › page/workers.spec.ts:150 › should report network activity `@chrome-beta-macos-latest`
⚠️ [chromium-page] › page/workers.spec.ts:271 › should support extra http headers `@chrome-beta-macos-latest`
⚠️ [chromium-library] › library/inspector/cli-codegen-pick-locator.spec.ts:35 › should update locator highlight `@chrome-beta-windows-latest`
⚠️ [chromium-page] › page/workers.spec.ts:25 › Page.workers @smoke `@chrome-macos-latest`
⚠️ [chromium-page] › page/workers.spec.ts:150 › should report network activity `@chrome-macos-latest`
⚠️ [chromium-page] › page/workers.spec.ts:271 › should support extra http headers `@chrome-macos-latest`
⚠️ [chromium-library] › library/chromium/oopif.spec.ts:152 › should take screenshot `@chromium-headed-macos-14-xlarge`
⚠️ [chromium-library] › library/popup.spec.ts:258 › should not throw when click closes popup `@chromium-tip-of-tree-headless-shell-ubuntu-22.04`
⚠️ [chromium-page] › page/page-wait-for-navigation.spec.ts:63 › should work with commit `@chromium-tip-of-tree-headless-shell-ubuntu-22.04`
⚠️ [chromium-page] › page/workers.spec.ts:25 › Page.workers @smoke `@chromium-tip-of-tree-macos-13--headed`
⚠️ [chromium-page] › page/workers.spec.ts:150 › should report network activity `@chromium-tip-of-tree-macos-13--headed`
⚠️ [chromium-page] › page/page-goto.spec.ts:828 › should return when navigation is committed if commit is specified `@chromium-tip-of-tree-windows-latest`
⚠️ [chromium-page] › page/page-wait-for-navigation.spec.ts:63 › should work with commit `@chromium-tip-of-tree-windows-latest`
⚠️ [chromium-page] › page/page-wait-for-url.spec.ts:52 › should work with commit `@chromium-tip-of-tree-windows-latest`
⚠️ [chromium-page] › page/page-wait-for-navigation.spec.ts:63 › should work with commit `@chromium-tip-of-tree-windows-latest--headed`
⚠️ [chromium-page] › page/page-wait-for-url.spec.ts:52 › should work with commit `@chromium-tip-of-tree-windows-latest--headed`
⚠️ [chromium-library] › library/popup.spec.ts:258 › should not throw when click closes popup `@chromium-ubuntu-24.04`
⚠️ [chromium-library] › library/inspector/cli-codegen-aria.spec.ts:76 › should update aria snapshot highlight `@chromium-windows-latest`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:94 › cli codegen › should click twice `@firefox-beta-macos-latest`
⚠️ [firefox-page] › page/page-wait-for-function.spec.ts:104 › should work with strict CSP policy `@firefox-beta-macos-latest`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-beta-ubuntu-22.04`
⚠️ [firefox-library] › library/browsercontext-events.spec.ts:154 › dialog event should work with inline script tag `@firefox-beta-windows-latest`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-beta-windows-latest`
⚠️ [firefox-library] › library/signals.spec.ts:25 › should close the browser when the node process closes `@firefox-beta-windows-latest`
⚠️ [firefox-page] › page/page-goto.spec.ts:83 › should work with Cross-Origin-Opener-Policy `@firefox-beta-windows-latest`
⚠️ [firefox-library] › library/capabilities.spec.ts:244 › requestFullscreen `@firefox-headed-macos-14-xlarge`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-headed-macos-14-xlarge`
⚠️ [firefox-library] › library/inspector/cli-codegen-aria.spec.ts:76 › should update aria snapshot highlight `@firefox-headed-macos-14-xlarge`
⚠️ [firefox-page] › page/page-goto.spec.ts:83 › should work with Cross-Origin-Opener-Policy `@firefox-headed-macos-14-xlarge`
⚠️ [firefox-library] › library/browsercontext-basic.spec.ts:377 › should emulate media in cross-process iframe `@firefox-headed-ubuntu-24.04`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-headed-ubuntu-24.04`
⚠️ [firefox-library] › library/trace-viewer.spec.ts:476 › should show snapshot URL `@firefox-headed-ubuntu-24.04`
⚠️ [firefox-page] › page/page-wait-for-function.spec.ts:104 › should work with strict CSP policy `@firefox-headed-ubuntu-24.04`
⚠️ [firefox-page] › page/workers.spec.ts:119 › should clear upon cross-process navigation `@firefox-headed-ubuntu-24.04`
⚠️ [firefox-library] › library/beforeunload.spec.ts:20 › should close browser with beforeunload page `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/browsercontext-clearcookies.spec.ts:72 › should remove cookies by name regex `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/browsercontext-locale.spec.ts:118 › should be isolated between contexts `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/browsercontext-reuse.spec.ts:94 › reuse launch › should re-add binding after reset `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/defaultbrowsercontext-2.spec.ts:87 › should support extraHTTPHeaders option `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/geolocation.spec.ts:20 › should work @smoke `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/har.spec.ts:442 › should have -1 _transferSize when its a failed request `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:984 › cli codegen › should record slider `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/inspector/cli-codegen-pytest.spec.ts:49 › should save the codegen output to a file if specified `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/inspector/cli-codegen-python.spec.ts:76 › should save the codegen output to a file if specified `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/trace-viewer.spec.ts:1934 › should load trace from HTTP with progress indicator `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/tracing.spec.ts:264 › should not include trace resources from the previous chunks `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/tracing.spec.ts:313 › should overwrite existing file `@firefox-headed-windows-latest`
⚠️ [firefox-page] › page/page-add-locator-handler.spec.ts:212 › should work when owner frame detaches `@firefox-headed-windows-latest`
⚠️ [firefox-page] › page/page-click.spec.ts:1053 › should click a button that is overlaid by a permission popup `@firefox-headed-windows-latest`
⚠️ [firefox-page] › page/page-wait-for-function.spec.ts:104 › should work with strict CSP policy `@firefox-headed-windows-latest`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-macos-13-large`
⚠️ [firefox-library] › library/video.spec.ts:579 › screencast › should capture static page in persistent context @smoke `@firefox-macos-13-large`
⚠️ [firefox-page] › page/page-event-request.spec.ts:182 › should return response body when Cross-Origin-Opener-Policy is set `@firefox-macos-13-large`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-macos-13-xlarge`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-macos-14-large`
⚠️ [firefox-page] › page/page-wait-for-function.spec.ts:104 › should work with strict CSP policy `@firefox-macos-14-large`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-macos-14-xlarge`
⚠️ [firefox-page] › page/page-emulate-media.spec.ts:144 › should keep reduced motion and color emulation after reload `@firefox-macos-14-xlarge`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-ubuntu-24.04`
⚠️ [firefox-page] › page/page-event-request.spec.ts:182 › should return response body when Cross-Origin-Opener-Policy is set `@firefox-ubuntu-24.04`
⚠️ [firefox-page] › page/page-wait-for-function.spec.ts:104 › should work with strict CSP policy `@firefox-ubuntu-24.04`
⚠️ [firefox-page] › page/page-wait-for-function.spec.ts:104 › should work with strict CSP policy `@firefox-windows-latest`
⚠️ [chromium-library] › library/browsercontext-reuse.spec.ts:114 › reuse launch › should reset serviceworker `@msedge-beta-macos-latest`
⚠️ [chromium-library] › library/browsercontext-reuse.spec.ts:114 › reuse launch › should reset serviceworker `@msedge-dev-macos-latest`
⚠️ [chromium-library] › library/global-fetch.spec.ts:216 › should resolve url relative to global baseURL option `@msedge-macos-latest`
⚠️ [chromium-library] › library/trace-viewer.spec.ts:1319 › should pick locator in iframe `@msedge-macos-latest`
⚠️ [chromium-page] › page/workers.spec.ts:271 › should support extra http headers `@msedge-macos-latest`
⚠️ [chromium-library] › library/trace-viewer.spec.ts:1934 › should load trace from HTTP with progress indicator `@msedge-windows-latest`
⚠️ [installation tests] › playwright-electron-should-work.spec.ts:21 › electron should work `@package-installations-ubuntu-latest-node22`
⚠️ [chromium-page] › page/page-screenshot.spec.ts:433 › page screenshot › should take fullPage screenshots during navigation `@tracing-chromium-tip-of-tree`
⚠️ [chromium-page] › page/page-wait-for-navigation.spec.ts:63 › should work with commit `@tracing-chromium-tip-of-tree`
⚠️ [firefox-page] › page/page-event-request.spec.ts:182 › should return response body when Cross-Origin-Opener-Policy is set `@tracing-firefox`
⚠️ [firefox-page] › page/page-wait-for-function.spec.ts:104 › should work with strict CSP policy `@tracing-firefox`
⚠️ [webkit-library] › library/inspector/cli-codegen-3.spec.ts:611 › cli codegen › should generate getByLabel without regex `@webkit-headed-ubuntu-22.04`
⚠️ [webkit-library] › library/browsercontext-reuse.spec.ts:270 › reuse connect › should reset mouse position `@webkit-headed-ubuntu-24.04`
⚠️ [webkit-library] › library/inspector/cli-codegen-1.spec.ts:593 › cli codegen › should check a radio button `@webkit-headed-ubuntu-24.04`
⚠️ [webkit-library] › library/inspector/cli-codegen-1.spec.ts:653 › cli codegen › should uncheck `@webkit-headed-ubuntu-24.04`
⚠️ [webkit-library] › library/browsercontext-reuse.spec.ts:114 › reuse launch › should reset serviceworker `@webkit-headed-windows-latest`
⚠️ [webkit-library] › library/browsercontext-reuse.spec.ts:114 › reuse connect › should reset serviceworker `@webkit-headed-windows-latest`
⚠️ [webkit-library] › library/inspector/cli-codegen-1.spec.ts:94 › cli codegen › should click twice `@webkit-headed-windows-latest`
⚠️ [webkit-library] › library/inspector/cli-codegen-1.spec.ts:120 › cli codegen › should type after clicking twice `@webkit-headed-windows-latest`
⚠️ [webkit-library] › library/inspector/cli-codegen-1.spec.ts:321 › cli codegen › should fill `@webkit-headed-windows-latest`
⚠️ [webkit-library] › library/inspector/cli-codegen-1.spec.ts:385 › cli codegen › should fill textarea `@webkit-headed-windows-latest`
⚠️ [webkit-library] › library/inspector/cli-codegen-2.spec.ts:477 › cli codegen › should fill tricky characters `@webkit-headed-windows-latest`
⚠️ [webkit-library] › library/inspector/cli-codegen-3.spec.ts:553 › cli codegen › should generate getByAltText `@webkit-headed-windows-latest`
⚠️ [webkit-page] › page/page-request-fallback.spec.ts:239 › post data › should amend binary post data `@webkit-macos-14-large`
⚠️ [webkit-page] › page/elementhandle-bounding-box.spec.ts:96 › should work with SVG nodes `@webkit-macos-14-xlarge`
⚠️ [webkit-page] › page/elementhandle-click.spec.ts:20 › should work @smoke `@webkit-macos-14-xlarge`
⚠️ [webkit-page] › page/wheel.spec.ts:70 › should dispatch wheel events after context menu was opened `@webkit-macos-15-xlarge`
⚠️ [webkit-library] › library/browsercontext-reuse.spec.ts:114 › reuse launch › should reset serviceworker `@webkit-windows-latest`

252296 passed, 9899 skipped, 2131 did not run


Merge workflow run.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

0 participants