Skip to content

feat(firefox): roll to r1572 - #43817

Open
microsoft-playwright-automation[bot] wants to merge 1 commit into
mainfrom
roll-into-pw-firefox/1572
Open

microsoft-playwright-automation[bot] wants to merge 1 commit into
mainfrom
roll-into-pw-firefox/1572

Conversation

@microsoft-playwright-automation

Copy link
Copy Markdown
Contributor

Browser build: https://github.com/microsoft/playwright-browsers/commit/5ff247feff4b2ea609f4531ec4fe848cb25f706a. Build has full platform coverage - check that all tests pass there.

@github-actions

Copy link
Copy Markdown
Contributor

Test results for "MCP"

5194 passed, 616 skipped


Merge workflow run.

@github-actions

Copy link
Copy Markdown
Contributor

Test results for "tests 1"

2 failed
❌ [chromium-library] › library/video.spec.ts:762 › screencast › VI-030 should work with video+trace @chromium-playwright-x64-ubuntu24-64-core-node22
❌ [firefox-page] › page/page-mouse.spec.ts:108 › MO-004 should pointerdown the div with a custom button @firefox-playwright-x64-ubuntu24-64-core-node22

23628 passed, 705 skipped


Merge workflow run.

@github-actions

Copy link
Copy Markdown
Contributor

🔴 The Firefox failure is caused by this PR

Hi, I'm the Playwright bot and I checked the CI failures for c8be5ff.

Details

The latest merged report has two failing tests: the Firefox failure follows directly from this PR's pointer ID change; the Chromium failure is a confirmed pre-existing flake.

Caused by this PR

  • [firefox-page] › page/page-mouse.spec.ts:108 › MO-004 should pointerdown the div with a custom button — fails on Ubuntu, macOS ARM, and Windows, including all three retries. This PR allocates a positive per-page mouse pointer ID in TargetRegistry.js and passes it through PageHandler.js, replacing DEFAULT_MOUSE_POINTER_ID. The assertion at line 137 still expects Firefox's event.pointerId to be 0; CI now receives positive IDs. The same test passed on the PR's base, a6fb02f, in this main run. Update the Firefox assertion to check the new per-page ID behavior instead of hard-coding 0.

Pre-existing flake

  • [chromium-library] › library/video.spec.ts:762 › screencast › VI-030 should work with video+trace — the trace contains no screencast frame, so reading frame.file throws. The same test on the same Ubuntu bot failed with the same error on main at 2fc0d9c, before this PR, in run 41080411125. In the refreshed results database (October 16–31), it failed after retries in 25 of 332 unrelated runs and passed in the other 307. This PR does not change Chromium's recording path.

Some tests 2 jobs are still running. This verdict covers the latest merged report and the completed failing jobs.

Triaged by the Playwright bot - agent run

@github-actions

Copy link
Copy Markdown
Contributor

Test results for "tests 2"

2203 failed
❌ [firefox-page] › page/page-mouse.spec.ts:108 › MO-004 should pointerdown the div with a custom button @tracing-firefox
❌ [firefox-page] › page/page-mouse.spec.ts:108 › MO-004 should pointerdown the div with a custom button @firefox-macos-15-large
❌ [firefox-page] › page/page-mouse.spec.ts:108 › MO-004 should pointerdown the div with a custom button @firefox-playwright-x64-server2025-64-core
❌ [firefox-page] › page/page-mouse.spec.ts:108 › MO-004 should pointerdown the div with a custom button @firefox-macos-15-xlarge
❌ [android-native] › android/browser.spec.ts:67 › should create new page
❌ [android-native] › android/browser.spec.ts:76 › should check
❌ [android-native] › android/browser.spec.ts:86 › should take page screenshot
❌ [android-native] › android/browser.spec.ts:124 › should be able to send CDP messages
❌ [android-native] › android/browser.spec.ts:134 › should be able to pass context options
❌ [android-native] › android/browser.spec.ts:156 › should record har
❌ [android-native] › android/device.spec.ts:21 › androidDevice.shell
❌ [android-native] › android/device.spec.ts:26 › androidDevice.open
❌ [android-native] › android/device.spec.ts:36 › androidDevice.screenshot
❌ [android-native] › android/device.spec.ts:46 › androidDevice.push
❌ [android-native] › android/device.spec.ts:56 › androidDevice.fill
❌ [android-native] › android/device.spec.ts:62 › androidDevice.wait should wait for the default timeout
❌ [android-native] › android/launch-server.spec.ts:24 › android.launchServer should connect to a device
❌ [android-native] › android/launch-server.spec.ts:33 › android.launchServer should work with host
❌ [android-native] › android/launch-server.spec.ts:44 › android.launchServer should handle close event correctly
❌ [android-native] › android/launch-server.spec.ts:66 › android.launchServer should be able to reconnect to a device
❌ [android-native] › android/launch-server.spec.ts:89 › android.launchServer should throw if there is no device with a specified serial number
❌ [android-native] › android/launch-server.spec.ts:95 › android.launchServer should not allow multiple connections
❌ [android-native] › android/launch-server.spec.ts:105 › android.launchServer BrowserServer.close() will disconnect the device
❌ [android-native] › android/launch-server.spec.ts:116 › android.launchServer BrowserServer.kill() will disconnect the device
❌ [android-native] › android/launch-server.spec.ts:127 › android.launchServer should terminate WS connection when device gets disconnected
❌ [android-native] › android/launch-server.spec.ts:158 › android.launchServer should be able to launch browser
❌ [android-native] › android/webview.spec.ts:19 › androidDevice.webView
❌ [android-native] › android/webview.spec.ts:27 › webView.page
❌ [android-native] › android/webview.spec.ts:35 › should navigate page internally
❌ [android-native] › android/webview.spec.ts:44 › should navigate page externally
❌ [android-native] › android/webview.spec.ts:58 › select webview from socketName
❌ [android-page] › page/elementhandle-click.spec.ts:20 › EH-010 should work Radoslav Kirilov (@smoke)
❌ [android-page] › page/elementhandle-click.spec.ts:27 › EH-011 should work with Node removed
❌ [android-page] › page/elementhandle-click.spec.ts:35 › EH-012 should work for Shadow DOM v1
❌ [android-page] › page/elementhandle-click.spec.ts:42 › EH-013 should work for TextNodes
❌ [android-page] › page/elementhandle-click.spec.ts:54 › EH-014 should throw for detached nodes
❌ [android-page] › page/elementhandle-click.spec.ts:63 › EH-015 should throw for hidden nodes with force
❌ [android-page] › page/elementhandle-click.spec.ts:71 › EH-016 should throw for recursively hidden nodes with force
❌ [android-page] › page/elementhandle-click.spec.ts:79 › EH-017 should throw for
elements with force
❌ [android-page] › page/elementhandle-click.spec.ts:86 › EH-018 should double click the button
❌ [android-page] › page/elementhandle-content-frame.spec.ts:21 › EH-019 should work
❌ [android-page] › page/elementhandle-content-frame.spec.ts:29 › EH-020 should work for cross-process iframes
❌ [android-page] › page/elementhandle-content-frame.spec.ts:37 › EH-021 should work for cross-frame evaluations
❌ [android-page] › page/elementhandle-content-frame.spec.ts:45 › EH-022 should return null for non-iframes
❌ [android-page] › page/elementhandle-content-frame.spec.ts:53 › EH-023 should return null for document.documentElement
❌ [android-page] › page/elementhandle-convenience.spec.ts:20 › EH-024 should have a nice preview
❌ [android-page] › page/elementhandle-convenience.spec.ts:33 › EH-025 should have a nice preview for non-ascii attributes/children
❌ [android-page] › page/elementhandle-convenience.spec.ts:40 › EH-026 getAttribute should work
❌ [android-page] › page/elementhandle-convenience.spec.ts:49 › EH-027 inputValue should work
❌ [android-page] › page/elementhandle-convenience.spec.ts:68 › EH-028 innerHTML should work
❌ [android-page] › page/elementhandle-convenience.spec.ts:75 › EH-029 innerText should work
❌ [android-page] › page/elementhandle-convenience.spec.ts:82 › EH-030 innerText should throw
❌ [android-page] › page/elementhandle-convenience.spec.ts:91 › EH-031 textContent should work
❌ [android-page] › page/elementhandle-convenience.spec.ts:98 › EH-032 textContent should work on ShadowRoot
❌ [android-page] › page/elementhandle-convenience.spec.ts:112 › EH-033 isVisible and isHidden should work
❌ [android-page] › page/elementhandle-convenience.spec.ts:131 › EH-034 isVisible should not throw when the DOM element is not connected
❌ [android-page] › page/elementhandle-convenience.spec.ts:150 › EH-035 isEnabled and isDisabled should work
❌ [android-page] › page/elementhandle-convenience.spec.ts:173 › EH-036 isEnabled and isDisabled should work with option/optgroup correctly :x: [android-page] › page/elementhandle-convenience.spec.ts:196 › EH-037 isEditable should work :x: [android-page] › page/elementhandle-convenience.spec.ts:210 › EH-038 isChecked should work :x: [android-page] › page/elementhandle-eval-on-selector.spec.ts:20 › EH-039 should work :x: [android-page] › page/elementhandle-eval-on-selector.spec.ts:27 › EH-040 should retrieve content from subtree :x: [android-page] › page/elementhandle-eval-on-selector.spec.ts:35 › EH-041 should throw in case of missing selector :x: [android-page] › page/elementhandle-eval-on-selector.spec.ts:43 › EH-042 should work for all :x: [android-page] › page/elementhandle-eval-on-selector.spec.ts:50 › EH-043 should retrieve content from subtree for all :x: [android-page] › page/elementhandle-eval-on-selector.spec.ts:58 › EH-044 should not throw in case of missing selector for all :x: [android-page] › page/elementhandle-misc.spec.ts:20 › EH-045 should hover :x: [android-page] › page/elementhandle-misc.spec.ts:27 › EH-046 should hover when Node is removed :x: [android-page] › page/elementhandle-misc.spec.ts:35 › EH-047 should fill input :x: [android-page] › page/elementhandle-misc.spec.ts:42 › EH-048 should fill input when Node is removed :x: [android-page] › page/elementhandle-misc.spec.ts:50 › EH-049 should check the box :x: [android-page] › page/elementhandle-misc.spec.ts:57 › EH-050 should check the box using setChecked :x: [android-page] › page/elementhandle-misc.spec.ts:66 › EH-051 should uncheck the box :x: [android-page] › page/elementhandle-misc.spec.ts:73 › EH-052 should select single option :x: [android-page] › page/elementhandle-misc.spec.ts:81 › EH-053 should focus a button :x: [android-page] › page/elementhandle-misc.spec.ts:89 › EH-054 should allow disposing twice :x: [android-page] › page/elementhandle-owner-frame.spec.ts:21 › EH-055 should work :x: [android-page] › page/elementhandle-owner-frame.spec.ts:29 › EH-056 should work for cross-process iframes :x: [android-page] › page/elementhandle-owner-frame.spec.ts:37 › EH-057 should work for document :x: [android-page] › page/elementhandle-owner-frame.spec.ts:45 › EH-058 should work for iframe elements :x: [android-page] › page/elementhandle-owner-frame.spec.ts:53 › EH-059 should work for cross-frame evaluations :x: [android-page] › page/elementhandle-owner-frame.spec.ts:61 › EH-060 should work for detached elements :x: [android-page] › page/elementhandle-owner-frame.spec.ts:76 › EH-061 should work for adopted elements :x: [android-page] › page/elementhandle-press.spec.ts:20 › EH-062 should work :x: [android-page] › page/elementhandle-press.spec.ts:26 › EH-063 should not select existing value :x: [android-page] › page/elementhandle-press.spec.ts:32 › EH-064 should reset selection when not focused :x: [android-page] › page/elementhandle-press.spec.ts:43 › EH-065 should not modify selection when focused :x: [android-page] › page/elementhandle-press.spec.ts:54 › EH-066 should work with number input :x: [android-page] › page/elementhandle-query-selector.spec.ts:20 › EH-067 should query existing element :x: [android-page] › page/elementhandle-query-selector.spec.ts:30 › EH-068 should return null for non-existing element :x: [android-page] › page/elementhandle-query-selector.spec.ts:37 › EH-069 should work for adopted elements :x: [android-page] › page/elementhandle-query-selector.spec.ts:63 › EH-070 should query existing elements :x: [android-page] › page/elementhandle-query-selector.spec.ts:72 › EH-071 should return empty array for non-existing elements :x: [android-page] › page/elementhandle-query-selector.spec.ts:80 › EH-072 xpath should query existing element :x: [android-page] › page/elementhandle-query-selector.spec.ts:90 › EH-073 xpath should return null for non-existing element :x: [android-page] › page/elementhandle-scroll-into-view.spec.ts:20 › EH-093 should work Radoslav Kirilov (@smoke) ❌ [android-page] › page/elementhandle-scroll-into-view.spec.ts:39 › EH-094 should throw for detached element ❌ [android-page] › page/elementhandle-scroll-into-view.spec.ts:58 › EH-095 should wait for display:none to become visible ❌ [android-page] › page/elementhandle-scroll-into-view.spec.ts:63 › EH-096 should scroll display:contents into view ❌ [android-page] › page/elementhandle-scroll-into-view.spec.ts:88 › EH-124 should scroll nested display:contents into view ❌ [android-page] › page/elementhandle-scroll-into-view.spec.ts:114 › EH-097 should work for visibility:hidden element ❌ [android-page] › page/elementhandle-scroll-into-view.spec.ts:120 › EH-098 should work for zero-sized element ❌ [android-page] › page/elementhandle-scroll-into-view.spec.ts:126 › EH-099 should wait for nested display:none to become visible ❌ [android-page] › page/elementhandle-scroll-into-view.spec.ts:131 › EH-100 should wait for element to stop moving ❌ [android-page] › page/elementhandle-scroll-into-view.spec.ts:147 › EH-101 should timeout waiting for visible ❌ [android-page] › page/elementhandle-select-text.spec.ts:20 › EH-102 should select textarea ❌ [android-page] › page/elementhandle-select-text.spec.ts:28 › EH-103 should select input ❌ [android-page] › page/elementhandle-select-text.spec.ts:36 › EH-104 should select plain div ❌ [android-page] › page/elementhandle-select-text.spec.ts:43 › EH-105 should timeout waiting for invisible element ❌ [android-page] › page/elementhandle-select-text.spec.ts:51 › EH-106 should wait for visible ❌ [android-page] › page/elementhandle-type.spec.ts:20 › EH-107 should work ❌ [android-page] › page/elementhandle-type.spec.ts:26 › EH-108 should not select existing value ❌ [android-page] › page/elementhandle-type.spec.ts:32 › EH-109 should reset selection when not focused ❌ [android-page] › page/elementhandle-type.spec.ts:43 › EH-110 should not modify selection when focused ❌ [android-page] › page/elementhandle-type.spec.ts:54 › EH-111 should work with number input ❌ [android-page] › page/elementhandle-wait-for-element-state.spec.ts:23 › EH-112 should wait for visible ❌ [android-page] › page/elementhandle-wait-for-element-state.spec.ts:34 › EH-113 should wait for already visible ❌ [android-page] › page/elementhandle-wait-for-element-state.spec.ts:40 › EH-114 should timeout waiting for visible ❌ [android-page] › page/elementhandle-wait-for-element-state.spec.ts:47 › EH-115 should throw waiting for visible when detached ❌ [android-page] › page/elementhandle-wait-for-element-state.spec.ts:56 › EH-116 should wait for hidden ❌ [android-page] › page/elementhandle-wait-for-element-state.spec.ts:67 › EH-117 should wait for already hidden ❌ [android-page] › page/elementhandle-wait-for-element-state.spec.ts:73 › EH-118 should wait for hidden when detached ❌ [android-page] › page/elementhandle-wait-for-element-state.spec.ts:84 › EH-119 should throw waiting for enabled when detached ❌ [android-page] › page/elementhandle-wait-for-element-state.spec.ts:93 › EH-120 should wait for aria enabled button ❌ [android-page] › page/elementhandle-wait-for-element-state.spec.ts:104 › EH-121 should wait for button with an aria-disabled parent ❌ [android-page] › page/elementhandle-wait-for-element-state.spec.ts:115 › EH-122 should wait for stable position ❌ [android-page] › page/elementhandle-wait-for-element-state.spec.ts:132 › EH-123 should wait for editable input ❌ [android-page] › page/eval-on-selector-all.spec.ts:20 › ES-027 should work with css selector ❌ [android-page] › page/eval-on-selector-all.spec.ts:26 › ES-028 should work with text selector ❌ [android-page] › page/eval-on-selector-all.spec.ts:32 › ES-029 should work with xpath selector ❌ [android-page] › page/eval-on-selector-all.spec.ts:38 › ES-030 should auto-detect css selector ❌ [android-page] › page/eval-on-selector-all.spec.ts:44 › ES-031 should support >> syntax ❌ [android-page] › page/eval-on-selector-all.spec.ts:50 › ES-032 should support * capture ❌ [android-page] › page/eval-on-selector-all.spec.ts:65 › ES-033 should support * capture when multiple paths match ❌ [android-page] › page/eval-on-selector-all.spec.ts:72 › ES-034 should return complex values ❌ [android-page] › page/eval-on-selector-all.spec.ts:78 › ES-035 should work with bogus Array.from ❌ [android-page] › page/eval-on-selector.spec.ts:20 › ES-001 should work with css selector ❌ [android-page] › page/eval-on-selector.spec.ts:26 › ES-002 should work with id selector ❌ [android-page] › page/eval-on-selector.spec.ts:32 › ES-003 should work with data-test selector ❌ [android-page] › page/eval-on-selector.spec.ts:38 › ES-004 should work with data-testid selector ❌ [android-page] › page/eval-on-selector.spec.ts:44 › ES-005 should work with data-test-id selector ❌ [android-page] › page/eval-on-selector.spec.ts:50 › ES-006 should work with text selector in quotes ❌ [android-page] › page/eval-on-selector.spec.ts:56 › ES-007 should work with xpath selector ❌ [android-page] › page/eval-on-selector.spec.ts:62 › ES-008 should work with text selector ❌ [android-page] › page/eval-on-selector.spec.ts:68 › ES-009 should auto-detect css selector ❌ [android-page] › page/eval-on-selector.spec.ts:74 › ES-010 should auto-detect css selector with attributes ❌ [android-page] › page/eval-on-selector.spec.ts:80 › ES-011 should auto-detect nested selectors ❌ [android-page] › page/eval-on-selector.spec.ts:86 › ES-012 should accept arguments ❌ [android-page] › page/eval-on-selector.spec.ts:92 › ES-013 should accept ElementHandles as arguments ❌ [android-page] › page/eval-on-selector.spec.ts:99 › ES-014 should throw error if no element is found ❌ [android-page] › page/eval-on-selector.spec.ts:105 › ES-015 should support >> syntax ❌ [android-page] › page/eval-on-selector.spec.ts:111 › ES-016 should support >> syntax with different engines ❌ [android-page] › page/eval-on-selector.spec.ts:117 › ES-017 should support spaces with >> syntax ❌ [android-page] › page/eval-on-selector.spec.ts:123 › ES-018 should not stop at first failure with >> syntax ❌ [android-page] › page/eval-on-selector.spec.ts:129 › ES-019 should support * capture ❌ [android-page] › page/eval-on-selector.spec.ts:137 › ES-020 should throw on multiple * captures ❌ [android-page] › page/eval-on-selector.spec.ts:142 › ES-021 should throw on malformed * capture ❌ [android-page] › page/eval-on-selector.spec.ts:147 › ES-022 should work with spaces in css attributes ❌ [android-page] › page/eval-on-selector.spec.ts:169 › ES-023 should work with quotes in css attributes ❌ [android-page] › page/eval-on-selector.spec.ts:184 › ES-024 should work with spaces in css attributes when missing ❌ [android-page] › page/eval-on-selector.spec.ts:191 › ES-025 should work with quotes in css attributes when missing ❌ [android-page] › page/eval-on-selector.spec.ts:198 › ES-026 should return complex values ❌ [android-page] › page/expect-boolean.spec.ts:21 › toBeChecked › EX-001 default ❌ [android-page] › page/expect-boolean.spec.ts:27 › toBeChecked › EX-002 with checked:true ❌ [android-page] › page/expect-boolean.spec.ts:33 › toBeChecked › EX-003 with checked:false ❌ [android-page] › page/expect-boolean.spec.ts:39 › toBeChecked › EX-004 with indeterminate:true ❌ [android-page] › page/expect-boolean.spec.ts:46 › toBeChecked › EX-005 with indeterminate:true and checked ❌ [android-page] › page/expect-boolean.spec.ts:54 › toBeChecked › EX-006 fail ❌ [android-page] › page/expect-boolean.spec.ts:67 › toBeChecked › EX-007 with not ❌ [android-page] › page/expect-boolean.spec.ts:73 › toBeChecked › EX-008 with not and checked:false ❌ [android-page] › page/expect-boolean.spec.ts:79 › toBeChecked › EX-009 fail with not ❌ [android-page] › page/expect-boolean.spec.ts:93 › toBeChecked › EX-010 fail with checked:false ❌ [android-page] › page/expect-boolean.spec.ts:107 › toBeChecked › EX-011 fail with indeterminate: true ❌ [android-page] › page/expect-boolean.spec.ts:120 › toBeChecked › EX-012 fail missing ❌ [android-page] › page/expect-boolean.spec.ts:137 › toBeChecked › EX-013 with role ❌ [android-page] › page/expect-boolean.spec.ts:147 › toBeChecked › EX-014 friendly log ❌ [android-page] › page/expect-boolean.spec.ts:157 › toBeChecked › EX-015 with impossible timeout ❌ [android-page] › page/expect-boolean.spec.ts:162 › toBeChecked › EX-016 with impossible timeout .not ❌ [android-page] › page/expect-boolean.spec.ts:169 › toBeEditable › EX-017 default ❌ [android-page] › page/expect-boolean.spec.ts:175 › toBeEditable › EX-018 with not ❌ [android-page] › page/expect-boolean.spec.ts:181 › toBeEditable › EX-019 with editable:true ❌ [android-page] › page/expect-boolean.spec.ts:187 › toBeEditable › EX-020 with editable:false ❌ [android-page] › page/expect-boolean.spec.ts:193 › toBeEditable › EX-021 with not and editable:false ❌ [android-page] › page/expect-boolean.spec.ts:199 › toBeEditable › EX-022 throws ❌ [android-page] › page/expect-boolean.spec.ts:208 › toBeEnabled › EX-023 default ❌ [android-page] › page/expect-boolean.spec.ts:214 › toBeEnabled › EX-024 with enabled:true ❌ [android-page] › page/expect-boolean.spec.ts:220 › toBeEnabled › EX-025 with enabled:false ❌ [android-page] › page/expect-boolean.spec.ts:226 › toBeEnabled › EX-026 failed ❌ [android-page] › page/expect-boolean.spec.ts:233 › toBeEnabled › EX-027 eventually ❌ [android-page] › page/expect-boolean.spec.ts:242 › toBeEnabled › EX-028 eventually with not ❌ [android-page] › page/expect-boolean.spec.ts:251 › toBeEnabled › EX-029 with not and enabled:false ❌ [android-page] › page/expect-boolean.spec.ts:257 › toBeEnabled › EX-030 toBeDisabled ❌ [android-page] › page/expect-boolean.spec.ts:264 › EX-031 toBeEmpty input ❌ [android-page] › page/expect-boolean.spec.ts:270 › EX-032 not.toBeEmpty ❌ [android-page] › page/expect-boolean.spec.ts:276 › EX-033 toBeEmpty div ❌ [android-page] › page/expect-boolean.spec.ts:282 › EX-034 toBeDisabled with value ❌ [android-page] › page/expect-boolean.spec.ts:288 › EX-035 toBeChecked with value ❌ [android-page] › page/expect-boolean.spec.ts:294 › EX-036 toBeHidden with value ❌ [android-page] › page/expect-boolean.spec.ts:300 › EX-037 not.toBeDisabled div ❌ [android-page] › page/expect-boolean.spec.ts:307 › toBeVisible › EX-038 default ❌ [android-page] › page/expect-boolean.spec.ts:313 › toBeVisible › EX-039 with not ❌ [android-page] › page/expect-boolean.spec.ts:319 › toBeVisible › EX-040 with visible:true ❌ [android-page] › page/expect-boolean.spec.ts:325 › toBeVisible › EX-041 with visible:false ❌ [android-page] › page/expect-boolean.spec.ts:331 › toBeVisible › EX-042 with not and visible:false ❌ [android-page] › page/expect-boolean.spec.ts:337 › toBeVisible › EX-043 eventually ❌ [android-page] › page/expect-boolean.spec.ts:346 › toBeVisible › EX-044 eventually with not ❌ [android-page] › page/expect-boolean.spec.ts:355 › toBeVisible › EX-045 fail ❌ [android-page] › page/expect-boolean.spec.ts:362 › toBeVisible › EX-046 fail with not ❌ [android-page] › page/expect-boolean.spec.ts:369 › toBeVisible › EX-047 with impossible timeout ❌ [android-page] › page/expect-boolean.spec.ts:374 › toBeVisible › EX-048 with impossible timeout .not ❌ [android-page] › page/expect-boolean.spec.ts:379 › toBeVisible › EX-049 with frameLocator ❌ [android-page] › page/expect-boolean.spec.ts:391 › toBeVisible › EX-050 with frameLocator 2 ❌ [android-page] › page/expect-boolean.spec.ts:403 › toBeVisible › EX-051 over navigation ❌ [android-page] › page/expect-boolean.spec.ts:416 › toBeHidden › EX-052 default ❌ [android-page] › page/expect-boolean.spec.ts:422 › toBeHidden › EX-053 when nothing matches ❌ [android-page] › page/expect-boolean.spec.ts:428 › toBeHidden › EX-054 with not ❌ [android-page] › page/expect-boolean.spec.ts:434 › toBeHidden › EX-055 eventually with not ❌ [android-page] › page/expect-boolean.spec.ts:443 › toBeHidden › EX-056 eventually ❌ [android-page] › page/expect-boolean.spec.ts:452 › toBeHidden › EX-057 fail ❌ [android-page] › page/expect-boolean.spec.ts:459 › toBeHidden › EX-058 fail with not ❌ [android-page] › page/expect-boolean.spec.ts:466 › toBeHidden › EX-059 fail with not when nothing matching ❌ [android-page] › page/expect-boolean.spec.ts:482 › toBeHidden › EX-060 with impossible timeout .not ❌ [android-page] › page/expect-boolean.spec.ts:487 › toBeHidden › EX-061 with impossible timeout ❌ [android-page] › page/expect-boolean.spec.ts:493 › EX-062 toBeFocused ❌ [android-page] › page/expect-boolean.spec.ts:500 › EX-063 toBeFocused with shadow elements ❌ [android-page] › page/expect-boolean.spec.ts:519 › EX-064 should print unknown engine error ❌ [android-page] › page/expect-boolean.spec.ts:524 › EX-065 should print selector syntax error ❌ [android-page] › page/expect-boolean.spec.ts:602 › toBeAttached › EX-073 default ❌ [android-page] › page/expect-boolean.spec.ts:608 › toBeAttached › EX-074 with hidden element ❌ [android-page] › page/expect-boolean.spec.ts:614 › toBeAttached › EX-075 with not ❌ [android-page] › page/expect-boolean.spec.ts:620 › toBeAttached › EX-076 with attached:true ❌ [android-page] › page/expect-boolean.spec.ts:626 › toBeAttached › EX-077 with attached:false ❌ [android-page] › page/expect-boolean.spec.ts:632 › toBeAttached › EX-078 with not and attached:false ❌ [android-page] › page/expect-boolean.spec.ts:638 › toBeAttached › EX-079 eventually ❌ [android-page] › page/expect-boolean.spec.ts:647 › toBeAttached › EX-080 eventually with not ❌ [android-page] › page/expect-boolean.spec.ts:656 › toBeAttached › EX-081 fail ❌ [android-page] › page/expect-boolean.spec.ts:663 › toBeAttached › EX-082 fail with not ❌ [android-page] › page/expect-boolean.spec.ts:670 › toBeAttached › EX-083 with impossible timeout ❌ [android-page] › page/expect-boolean.spec.ts:675 › toBeAttached › EX-084 with impossible timeout .not ❌ [android-page] › page/expect-boolean.spec.ts:680 › toBeAttached › EX-085 with frameLocator ❌ [android-page] › page/expect-boolean.spec.ts:692 › toBeAttached › EX-086 over navigation ❌ [android-page] › page/expect-matcher-result.spec.ts:20 › EX-176 toMatchText-based assertions should have matcher result ❌ [android-page] › page/expect-matcher-result.spec.ts:75 › EX-177 toBeTruthy-based assertions should have matcher result ❌ [android-page] › page/expect-matcher-result.spec.ts:129 › EX-178 toEqual-based assertions should have matcher result ❌ [android-page] › page/expect-matcher-result.spec.ts:180 › EX-179 toBeChecked({ checked }) should have expected ❌ [android-page] › page/expect-matcher-result.spec.ts:312 › EX-180 toHaveScreenshot should populate matcherResult ❌ [android-page] › page/expect-misc.spec.ts:21 › toHaveCount › EX-181 toHaveCount pass ❌ [android-page] › page/expect-misc.spec.ts:33 › toHaveCount › EX-182 pass zero ❌ [android-page] › page/expect-misc.spec.ts:40 › toHaveCount › EX-183 eventually pass zero ❌ [android-page] › page/expect-misc.spec.ts:48 › toHaveCount › EX-184 eventually pass non-zero ❌ [android-page] › page/expect-misc.spec.ts:57 › toHaveCount › EX-185 eventually pass not non-zero ❌ [android-page] › page/expect-misc.spec.ts:66 › toHaveCount › EX-186 fail zero ❌ [android-page] › page/expect-misc.spec.ts:79 › toHaveCount › EX-187 fail zero 2 ❌ [android-page] › page/expect-misc.spec.ts:94 › toHaveJSProperty › EX-188 pass ❌ [android-page] › page/expect-misc.spec.ts:101 › toHaveJSProperty › EX-189 fail ❌ [android-page] › page/expect-misc.spec.ts:109 › toHaveJSProperty › EX-190 pass string ❌ [android-page] › page/expect-misc.spec.ts:116 › toHaveJSProperty › EX-191 fail string ❌ [android-page] › page/expect-misc.spec.ts:130 › toHaveJSProperty › EX-192 pass number ❌ [android-page] › page/expect-misc.spec.ts:137 › toHaveJSProperty › EX-193 fail number ❌ [android-page] › page/expect-misc.spec.ts:151 › toHaveJSProperty › EX-194 pass boolean ❌ [android-page] › page/expect-misc.spec.ts:158 › toHaveJSProperty › EX-195 fail boolean ❌ [android-page] › page/expect-misc.spec.ts:172 › toHaveJSProperty › EX-196 pass boolean 2 ❌ [android-page] › page/expect-misc.spec.ts:179 › toHaveJSProperty › EX-197 fail boolean 2 ❌ [android-page] › page/expect-misc.spec.ts:193 › toHaveJSProperty › EX-198 pass undefined ❌ [android-page] › page/expect-misc.spec.ts:199 › toHaveJSProperty › EX-199 pass null ❌ [android-page] › page/expect-misc.spec.ts:206 › toHaveJSProperty › EX-200 pass nested ❌ [android-page] › page/expect-misc.spec.ts:216 › toHaveJSProperty › EX-201 fail nested ❌ [android-page] › page/expect-misc.spec.ts:228 › toHaveClass › EX-202 pass ❌ [android-page] › page/expect-misc.spec.ts:234 › toHaveClass › EX-203 pass with SVGs ❌ [android-page] › page/expect-misc.spec.ts:239 › toHaveClass › EX-204 fail ❌ [android-page] › page/expect-misc.spec.ts:255 › toHaveClass › EX-205 pass with array ❌ [android-page] › page/expect-misc.spec.ts:261 › toHaveClass › EX-206 fail with array ❌ [android-page] › page/expect-misc.spec.ts:272 › toContainClass › EX-207 pass ❌ [android-page] › page/expect-misc.spec.ts:283 › toContainClass › EX-208 pass with SVGs ❌ [android-page] › page/expect-misc.spec.ts:288 › toContainClass › EX-209 fail ❌ [android-page] › page/expect-misc.spec.ts:304 › toContainClass › EX-210 pass with array ❌ [android-page] › page/expect-misc.spec.ts:313 › toContainClass › EX-211 fail with array ❌ [android-page] › page/expect-misc.spec.ts:324 › toHaveTitle › EX-212 pass ❌ [android-page] › page/expect-misc.spec.ts:329 › toHaveTitle › EX-213 fail ❌ [android-page] › page/expect-misc.spec.ts:345 › toHaveURL › EX-214 pass ❌ [android-page] › page/expect-misc.spec.ts:350 › toHaveURL › EX-215 fail string ❌ [android-page] › page/expect-misc.spec.ts:363 › toHaveURL › EX-216 fail with invalid argument ❌ [android-page] › page/expect-misc.spec.ts:375 › toHaveURL › EX-217 fail with positive predicate ❌ [android-page] › page/expect-misc.spec.ts:386 › toHaveURL › EX-218 fail with negative predicate ❌ [android-page] › page/expect-misc.spec.ts:397 › toHaveURL › EX-219 resolve predicate on initial call ❌ [android-page] › page/expect-misc.spec.ts:402 › toHaveURL › EX-220 resolve predicate after retries ❌ [android-page] › page/expect-misc.spec.ts:409 › toHaveURL › EX-221 support ignoreCase ❌ [android-page] › page/expect-misc.spec.ts:414 › toHaveURL › EX-222 support URLPattern ❌ [android-page] › page/expect-misc.spec.ts:425 › toHaveAttribute › EX-223 pass ❌ [android-page] › page/expect-misc.spec.ts:431 › toHaveAttribute › EX-224 should not match missing attribute ❌ [android-page] › page/expect-misc.spec.ts:464 › toHaveAttribute › EX-225 should match boolean attribute ❌ [android-page] › page/expect-misc.spec.ts:494 › toHaveAttribute › EX-226 should match attribute without value ❌ [android-page] › page/expect-misc.spec.ts:502 › toHaveAttribute › EX-227 should support boolean attribute with options ❌ [android-page] › page/expect-misc.spec.ts:510 › toHaveAttribute › EX-228 support ignoreCase ❌ [android-page] › page/expect-misc.spec.ts:519 › toHaveCSS › EX-229 pass ❌ [android-page] › page/expect-misc.spec.ts:525 › toHaveCSS › EX-230 should support pseudo element ❌ [android-page] › page/expect-misc.spec.ts:539 › toHaveCSS › EX-231 custom css properties ❌ [android-page] › page/expect-misc.spec.ts:547 › toHaveId › EX-232 pass ❌ [android-page] › page/expect-misc.spec.ts:555 › toBeInViewport › EX-233 should work ❌ [android-page] › page/expect-misc.spec.ts:567 › toBeInViewport › EX-234 should respect ratio option ❌ [android-page] › page/expect-misc.spec.ts:588 › toBeInViewport › EX-235 should have good stack ❌ [android-page] › page/expect-misc.spec.ts:602 › toBeInViewport › EX-236 should report intersection even if fully covered by other element ❌ [android-page] › page/expect-misc.spec.ts:611 › EX-237 toHaveCount should not produce logs twice ❌ [android-page] › page/expect-misc.spec.ts:621 › EX-238 toHaveText should not produce logs twice ❌ [android-page] › page/expect-misc.spec.ts:631 › EX-239 toHaveText that does not match should not produce logs twice ❌ [android-page] › page/expect-misc.spec.ts:640 › EX-240 strict mode violation error format ❌ [android-page] › page/expect-misc.spec.ts:655 › EX-241 invalid selector error format ❌ [android-page] › page/expect-misc.spec.ts:668 › EX-242 should report expect error details when page closes during expect ❌ [android-page] › page/expect-misc.spec.ts:679 › EX-243 should report page close reason when page closes during expect ❌ [android-page] › page/expect-timeout.spec.ts:20 › EX-244 should print element not found ❌ [android-page] › page/expect-timeout.spec.ts:34 › EX-245 should print timed out error message when value does not match ❌ [android-page] › page/expect-timeout.spec.ts:48 › EX-246 should print timed out error message with impossible timeout ❌ [android-page] › page/expect-timeout.spec.ts:61 › EX-247 should print timed out error message when value does not match with impossible timeout ❌ [android-page] › page/expect-timeout.spec.ts:75 › EX-248 should have timeout error name ❌ [android-page] › page/expect-timeout.spec.ts:80 › EX-249 should not throw when navigating during one-shot check ❌ [android-page] › page/expect-timeout.spec.ts:88 › EX-250 should not throw when navigating during first locator handler check ❌ [android-page] › page/expect-timeout.spec.ts:97 › EX-251 should timeout during first locator handler check ❌ [android-page] › page/expect-timeout.spec.ts:114 › EX-252 should not miss element that appears between retries before the deadline ❌ [android-page] › page/expect-timeout.spec.ts:124 › EX-253 should fail like a timeout when the signal is aborted mid-assertion ❌ [android-page] › page/expect-timeout.spec.ts:144 › EX-254 should fail like a timeout when toHaveText is aborted mid-assertion ❌ [android-page] › page/expect-timeout.spec.ts:155 › EX-255 should fail like a timeout when toHaveCount is aborted mid-assertion ❌ [android-page] › page/expect-timeout.spec.ts:166 › EX-256 should fail like a timeout when toMatchAriaSnapshot is aborted mid-assertion ❌ [android-page] › page/expect-timeout.spec.ts:177 › EX-257 should fail like a timeout when toHaveURL is aborted mid-assertion ❌ [android-page] › page/expect-timeout.spec.ts:188 › EX-258 should fail the assertion when the signal is already aborted ❌ [android-page] › page/expect-to-have-accessible.spec.ts:19 › EX-259 toHaveAccessibleName ❌ [android-page] › page/expect-to-have-accessible.spec.ts:41 › EX-260 toHaveAccessibleDescription ❌ [android-page] › page/expect-to-have-accessible.spec.ts:59 › EX-261 toHaveAccessibleErrorMessage ❌ [android-page] › page/expect-to-have-accessible.spec.ts:78 › EX-262 toHaveAccessibleErrorMessage should handle multiple aria-errormessage references ❌ [android-page] › page/expect-to-have-accessible.spec.ts:111 › toHaveAccessibleErrorMessage should handle aria-invalid attribute › evaluated in false › EX-263 no aria-invalid attribute ❌ [android-page] › page/expect-to-have-accessible.spec.ts:115 › toHaveAccessibleErrorMessage should handle aria-invalid attribute › evaluated in false › EX-264 aria-invalid="false" ❌ [android-page] › page/expect-to-have-accessible.spec.ts:119 › toHaveAccessibleErrorMessage should handle aria-invalid attribute › evaluated in false › EX-265 aria-invalid="" (empty string) ❌ [android-page] › page/expect-to-have-accessible.spec.ts:125 › toHaveAccessibleErrorMessage should handle aria-invalid attribute › evaluated in true › EX-266 aria-invalid="true" ❌ [android-page] › page/expect-to-have-accessible.spec.ts:129 › toHaveAccessibleErrorMessage should handle aria-invalid attribute › evaluated in true › EX-267 aria-invalid="foo" (unrecognized value) ❌ [android-page] › page/expect-to-have-accessible.spec.ts:138 › EX-268 should show error message when validity is false and aria-invalid is true ❌ [android-page] › page/expect-to-have-accessible.spec.ts:150 › EX-269 should show error message when validity is true and aria-invalid is true ❌ [android-page] › page/expect-to-have-accessible.spec.ts:162 › EX-270 should show error message when validity is false and aria-invalid is false ❌ [android-page] › page/expect-to-have-accessible.spec.ts:174 › EX-271 should not show error message when validity is true and aria-invalid is false ❌ [android-page] › page/expect-to-have-accessible.spec.ts:186 › EX-272 should show error message for all roles ❌ [android-page] › page/expect-to-have-accessible.spec.ts:196 › EX-273 toHaveRole ❌ [android-page] › page/expect-to-have-text.spec.ts:21 › toHaveText with regex › EX-274 pass ❌ [android-page] › page/expect-to-have-text.spec.ts:34 › toHaveText with regex › EX-275 fail ❌ [android-page] › page/expect-to-have-text.spec.ts:51 › toContainText with regex › EX-276 pass ❌ [android-page] › page/expect-to-have-text.spec.ts:60 › toContainText with regex › EX-277 fail ❌ [android-page] › page/expect-to-have-text.spec.ts:70 › toContainText with string › EX-278 pass ❌ [android-page] › page/expect-to-have-text.spec.ts:76 › toContainText with string › EX-279 fail ❌ [android-page] › page/expect-to-have-text.spec.ts:93 › toHaveText with text › EX-280 pass ❌ [android-page] › page/expect-to-have-text.spec.ts:108 › toHaveText with text › EX-281 pass contain ❌ [android-page] › page/expect-to-have-text.spec.ts:120 › toHaveText with text › EX-282 fail ❌ [android-page] › page/expect-to-have-text.spec.ts:128 › toHaveText with text › EX-283 pass eventually ❌ [android-page] › page/expect-to-have-text.spec.ts:137 › toHaveText with text › EX-284 with userInnerText ❌ [android-page] › page/expect-to-have-text.spec.ts:143 › toHaveText with text › EX-285 in shadow dom ❌ [android-page] › page/expect-to-have-text.spec.ts:164 › toHaveText with text › EX-286 fail with impossible timeout ❌ [android-page] › page/expect-to-have-text.spec.ts:171 › toHaveText with text › EX-287 do not show "element(s) not found" when the real failure is a string mismatch ❌ [android-page] › page/expect-to-have-text.spec.ts:192 › not.toHaveText › EX-288 pass ❌ [android-page] › page/expect-to-have-text.spec.ts:200 › not.toHaveText › EX-289 fail ❌ [android-page] › page/expect-to-have-text.spec.ts:208 › not.toHaveText › EX-290 should work when selector does not match ❌ [android-page] › page/expect-to-have-text.spec.ts:218 › toHaveText with array › EX-291 pass ❌ [android-page] › page/expect-to-have-text.spec.ts:227 › toHaveText with array › EX-292 pass lazy ❌ [android-page] › page/expect-to-have-text.spec.ts:238 › toHaveText with array › EX-293 pass empty ❌ [android-page] › page/expect-to-have-text.spec.ts:244 › toHaveText with array › EX-294 pass not empty ❌ [android-page] › page/expect-to-have-text.spec.ts:250 › toHaveText with array › EX-295 pass on empty ❌ [android-page] › page/expect-to-have-text.spec.ts:256 › toHaveText with array › EX-296 fail on not+empty ❌ [android-page] › page/expect-to-have-text.spec.ts:265 › toHaveText with array › EX-297 pass eventually empty ❌ [android-page] › page/expect-to-have-text.spec.ts:274 › toHaveText with array › EX-298 fail ❌ [android-page] › page/expect-to-have-text.spec.ts:298 › toHaveText with array › EX-299 fail on repeating array matchers ❌ [android-page] › page/expect-to-have-text.spec.ts:307 › toContainText with array › EX-300 pass ❌ [android-page] › page/expect-to-have-text.spec.ts:315 › toContainText with array › EX-301 fail ❌ [android-page] › page/expect-to-have-value.spec.ts:20 › EX-302 should work ❌ [android-page] › page/expect-to-have-value.spec.ts:27 › EX-303 should work with label ❌ [android-page] › page/expect-to-have-value.spec.ts:33 › EX-304 should work with regex ❌ [android-page] › page/expect-to-have-value.spec.ts:40 › EX-305 should support failure ❌ [android-page] › page/expect-to-have-value.spec.ts:49 › toHaveValues with multi-select › EX-306 works with text ❌ [android-page] › page/expect-to-have-value.spec.ts:62 › toHaveValues with multi-select › EX-307 follows labels ❌ [android-page] › page/expect-to-have-value.spec.ts:76 › toHaveValues with multi-select › EX-308 exact match with text failure ❌ [android-page] › page/expect-to-have-value.spec.ts:90 › toHaveValues with multi-select › EX-309 works with regex ❌ [android-page] › page/expect-to-have-value.spec.ts:103 › toHaveValues with multi-select › EX-310 fails when items not selected ❌ [android-page] › page/expect-to-have-value.spec.ts:117 › toHaveValues with multi-select › EX-311 fails when multiple not specified ❌ [android-page] › page/expect-to-have-value.spec.ts:131 › toHaveValues with multi-select › EX-312 fails when not a select element ❌ [android-page] › page/expect-with-snapshot.spec.ts:20 › containment matchers print full element subtree › EX-313 toHaveText failure includes full element subtree ❌ [android-page] › page/expect-with-snapshot.spec.ts:29 › containment matchers print full element subtree › EX-314 toContainText failure includes full element subtree ❌ [android-page] › page/expect-with-snapshot.spec.ts:39 › property matchers print only the element line › EX-315 toBeChecked failure prints just the input ❌ [android-page] › page/expect-with-snapshot.spec.ts:46 › property matchers print only the element line › EX-316 toHaveAttribute failure clips descendant subtree ❌ [android-page] › page/expect-with-snapshot.spec.ts:57 › property matchers print only the element line › EX-317 toHaveRole failure prints just the element line ❌ [android-page] › page/expect-with-snapshot.spec.ts:64 › property matchers print only the element line › EX-318 toHaveValue failure prints the input element ❌ [android-page] › page/expect-with-snapshot.spec.ts:71 › property matchers print only the element line › EX-319 toHaveCSS failure prints the element line ❌ [android-page] › page/expect-with-snapshot.spec.ts:80 › hidden or missing elements print full page snapshot › EX-320 toBeVisible on hidden element prints full page snapshot ❌ [android-page] › page/expect-with-snapshot.spec.ts:91 › hidden or missing elements print full page snapshot › EX-321 toBeVisible on missing element prints full page snapshot ❌ [android-page] › page/expect-with-snapshot.spec.ts:98 › hidden or missing elements print full page snapshot › EX-322 toHaveText on missing element prints full page snapshot ❌ [android-page] › page/expect-with-snapshot.spec.ts:105 › hidden or missing elements print full page snapshot › EX-323 toHaveTitle failure prints full page snapshot ❌ [android-page] › page/expect-with-snapshot.spec.ts:114 › matchers that should not include an aria snapshot › EX-324 toHaveCount failure has no aria snapshot ❌ [android-page] › page/expect-with-snapshot.spec.ts:120 › matchers that should not include an aria snapshot › EX-325 toHaveText with array has no aria snapshot ❌ [android-page] › page/expect-with-snapshot.spec.ts:126 › matchers that should not include an aria snapshot › EX-326 toMatchAriaSnapshot failure has no extra aria snapshot ❌ [android-page] › page/frame-evaluate.spec.ts:21 › FR-001 should have different execution contexts ❌ [android-page] › page/frame-evaluate.spec.ts:31 › FR-002 should have correct execution contexts Radoslav Kirilov (@smoke) ❌ [android-page] › page/frame-evaluate.spec.ts:45 › FR-003 should dispose context on navigation ❌ [android-page] › page/frame-evaluate.spec.ts:55 › FR-004 should dispose context on cross-origin navigation ❌ [android-page] › page/frame-evaluate.spec.ts:65 › FR-005 should execute after cross-site navigation ❌ [android-page] › page/frame-evaluate.spec.ts:73 › FR-006 should not allow cross-frame js handles ❌ [android-page] › page/frame-evaluate.spec.ts:91 › FR-007 should allow cross-frame element handles ❌ [android-page] › page/frame-evaluate.spec.ts:98 › FR-008 should not allow cross-frame element handles when frames do not script each other ❌ [android-page] › page/frame-evaluate.spec.ts:108 › FR-009 should throw for detached frames ❌ [android-page] › page/frame-evaluate.spec.ts:116 › FR-010 should be isolated between frames ❌ [android-page] › page/frame-evaluate.spec.ts:135 › FR-011 should work in iframes that failed initial navigation ❌ [android-page] › page/frame-evaluate.spec.ts:152 › FR-012 should work in iframes that interrupted initial javascript url navigation ❌ [android-page] › page/frame-evaluate.spec.ts:169 › FR-013 evaluateHandle should work ❌ [android-page] › page/frame-frame-element.spec.ts:21 › FR-014 should work Radoslav Kirilov (@smoke) ❌ [android-page] › page/frame-frame-element.spec.ts:35 › FR-015 should work with contentFrame ❌ [android-page] › page/frame-frame-element.spec.ts:43 › FR-016 should work with frameset ❌ [android-page] › page/frame-frame-element.spec.ts:51 › FR-017 should throw when detached ❌ [android-page] › page/frame-frame-element.spec.ts:59 › FR-018 should work inside closed shadow root ❌ [android-page] › page/frame-frame-element.spec.ts:79 › FR-019 should work inside declarative shadow root ❌ [android-page] › page/frame-goto.spec.ts:21 › FR-020 should navigate subframes Radoslav Kirilov (@smoke) ❌ [android-page] › page/frame-goto.spec.ts:31 › FR-021 should reject when frame detaches ❌ [android-page] › page/frame-goto.spec.ts:46 › FR-022 should continue after client redirect ❌ [android-page] › page/frame-goto.spec.ts:57 › FR-023 should return matching responses ❌ [android-page] › page/frame-hierarchy.spec.ts:38 › FR-024 should handle nested frames Radoslav Kirilov (@smoke) ❌ [android-page] › page/frame-hierarchy.spec.ts:52 › FR-025 should send events when frames are manipulated dynamically ❌ [android-page] › page/frame-hierarchy.spec.ts:80 › FR-026 should send "framenavigated" when navigating on anchor URLs ❌ [android-page] › page/frame-hierarchy.spec.ts:89 › FR-027 should persist mainFrame on cross-process navigation ❌ [android-page] › page/frame-hierarchy.spec.ts:96 › FR-028 should not send attach/detach events for main frame ❌ [android-page] › page/frame-hierarchy.spec.ts:104 › FR-029 should detach child frames on navigation ❌ [android-page] › page/frame-hierarchy.spec.ts:125 › FR-030 should support framesets ❌ [android-page] › page/frame-hierarchy.spec.ts:146 › FR-031 should report frame from-inside shadow DOM ❌ [android-page] › page/frame-hierarchy.spec.ts:158 › FR-032 should report frame.name() ❌ [android-page] › page/frame-hierarchy.spec.ts:174 › FR-033 should report frame.parent() ❌ [android-page] › page/frame-hierarchy.spec.ts:182 › FR-034 should report different frame instance when frame re-attaches ❌ [android-page] › page/frame-hierarchy.spec.ts:198 › FR-035 should refuse to display x-frame-options:deny iframe ❌ [android-page] › page/frame-hierarchy.spec.ts:217 › FR-036 should return frame.page() ❌ [android-page] › page/interception.spec.ts:24 › RO-151 should work with navigation Radoslav Kirilov (@smoke) ❌ [android-page] › page/interception.spec.ts:38 › RO-152 should intercept after a service worker ❌ [android-page] › page/interception.spec.ts:211 › RO-155 should throw on page.route with invalid glob ❌ [android-page] › page/interception.spec.ts:215 › RO-156 should intercept by glob ❌ [android-page] › page/interception.spec.ts:229 › RO-157 should intercept network activity from worker ❌ [android-page] › page/interception.spec.ts:250 › RO-158 should intercept worker requests when enabled after worker creation ❌ [android-page] › page/interception.spec.ts:283 › RO-159 should intercept network activity from worker 2 ❌ [android-page] › page/interception.spec.ts:303 › RO-160 should work with regular expression passed from a different context ❌ [android-page] › page/interception.spec.ts:327 › RO-161 should intercept every request matching a global regexp ❌ [android-page] › page/interception.spec.ts:340 › RO-162 should not break remote worker importScripts ❌ [android-page] › page/interception.spec.ts:348 › RO-163 should disable memory cache when intercepting ❌ [android-page] › page/interception.spec.ts:366 › RO-164 should intercept blob url requests ❌ [android-page] › page/jshandle-as-element.spec.ts:20 › JH-001 should work Radoslav Kirilov (@smoke) ❌ [android-page] › page/jshandle-as-element.spec.ts:26 › JH-002 should return null for non-elements ❌ [android-page] › page/jshandle-as-element.spec.ts:32 › JH-003 should return ElementHandle for TextNodes ❌ [android-page] › page/jshandle-as-element.spec.ts:40 › JH-004 should work with nullified Node ❌ [android-page] › page/jshandle-evaluate.spec.ts:20 › JH-005 should work with function Radoslav Kirilov (@smoke) ❌ [android-page] › page/jshandle-evaluate.spec.ts:28 › JH-006 should work with expression ❌ [android-page] › page/jshandle-json-value.spec.ts:20 › JH-007 should work Radoslav Kirilov (@smoke) ❌ [android-page] › page/jshandle-json-value.spec.ts:26 › JH-008 should work with dates ❌ [android-page] › page/jshandle-json-value.spec.ts:32 › JH-009 should handle circular objects ❌ [android-page] › page/jshandle-properties.spec.ts:21 › JH-010 should work Radoslav Kirilov (@smoke) ❌ [android-page] › page/jshandle-properties.spec.ts:31 › JH-011 should work with undefined, null, and empty ❌ [android-page] › page/jshandle-properties.spec.ts:44 › JH-012 should work with unserializable values ❌ [android-page] › page/jshandle-properties.spec.ts:61 › JH-013 getProperties should work ❌ [android-page] › page/jshandle-properties.spec.ts:71 › JH-014 getProperties should return empty map for non-objects ❌ [android-page] › page/jshandle-properties.spec.ts:77 › JH-015 getProperties should return properties inhertied from super class ❌ [android-page] › page/jshandle-properties.spec.ts:99 › JH-016 getProperties should return own enumerable properties only ❌ [android-page] › page/jshandle-properties.spec.ts:119 › JH-017 getProperties should work with elements ❌ [android-page] › page/jshandle-to-string.spec.ts:20 › JH-018 should work for primitives ❌ [android-page] › page/jshandle-to-string.spec.ts:27 › JH-019 should work for complicated objects ❌ [android-page] › page/jshandle-to-string.spec.ts:35 › JH-020 should beautifully render sparse arrays ❌ [android-page] › page/jshandle-to-string.spec.ts:52 › JH-021 should work for promises ❌ [android-page] › page/jshandle-to-string.spec.ts:59 › JH-022 should work with different subtypes Radoslav Kirilov (@smoke) ❌ [android-page] › page/jshandle-to-string.spec.ts:82 › JH-023 should work with previewable subtypes ❌ [android-page] › page/locator-any-frame.spec.ts:36 › LO-001 should click a button inside an iframe ❌ [android-page] › page/locator-any-frame.spec.ts:44 › LO-002 should click a button in the main frame ❌ [android-page] › page/locator-any-frame.spec.ts:52 › LO-003 should fail click when elements match in multiple frames ❌ [android-page] › page/locator-any-frame.spec.ts:63 › LO-004 should fail click upon strict mode violation inside a single frame ❌ [android-page] › page/locator-any-frame.spec.ts:73 › LO-005 should time out on click when there are no matches ❌ [android-page] › page/locator-any-frame.spec.ts:82 › LO-006 should count elements in a single frame ❌ [android-page] › page/locator-any-frame.spec.ts:91 › LO-007 should fail count when elements match in multiple frames ❌ [android-page] › page/locator-any-frame.spec.ts:100 › LO-008 should support toHaveCount ❌ [android-page] › page/locator-any-frame.spec.ts:108 › LO-009 should wait for a frame to appear with toHaveCount ❌ [android-page] › page/locator-any-frame.spec.ts:122 › LO-010 should fail toHaveCount when elements match in multiple frames ❌ [android-page] › page/locator-any-frame.spec.ts:133 › LO-011 should support toHaveText ❌ [android-page] › page/locator-any-frame.spec.ts:140 › LO-012 should support toHaveText with an array ❌ [android-page] › page/locator-any-frame.spec.ts:147 › LO-013 should fail toHaveText when elements match in multiple frames ❌ [android-page] › page/locator-any-frame.spec.ts:158 › LO-014 should fail toHaveText with an array when elements match in multiple frames ❌ [android-page] › page/locator-any-frame.spec.ts:168 › LO-015 should fail toHaveText upon strict mode violation inside a single frame ❌ [android-page] › page/locator-any-frame.spec.ts:178 › LO-016 should support evaluate ❌ [android-page] › page/locator-any-frame.spec.ts:185 › LO-017 should fail evaluate when elements match in multiple frames ❌ [android-page] › page/locator-any-frame.spec.ts:195 › LO-018 should time out on evaluate when there are no matches ❌ [android-page] › page/locator-any-frame.spec.ts:204 › LO-019 should support evaluateAll ❌ [android-page] › page/locator-any-frame.spec.ts:213 › LO-020 should fail evaluateAll when elements match in multiple frames ❌ [android-page] › page/locator-any-frame.spec.ts:223 › LO-021 should support hasText filter ❌ [android-page] › page/locator-any-frame.spec.ts:230 › LO-022 should support first/last/nth ❌ [android-page] › page/locator-any-frame.spec.ts:240 › LO-023 should support nth in the middle of the chain ❌ [android-page] › page/locator-any-frame.spec.ts:247 › LO-024 should support composite locators ❌ [android-page] › page/locator-any-frame.spec.ts:254 › LO-025 should support capture ❌ [android-page] › page/locator-any-frame.spec.ts:261 › LO-026 should find a frame inside the scope ❌ [android-page] › page/locator-any-frame.spec.ts:272 › LO-027 should find a nested frame inside the scope ❌ [android-page] › page/locator-any-frame.spec.ts:289 › LO-028 should find a frame inside the scope while another iframe is stalled ❌ [android-page] › page/locator-any-frame.spec.ts:301 › LO-029 should respect the scope without a frame inside the scope ❌ [android-page] › page/locator-any-frame.spec.ts:312 › LO-030 should not match a chain across a frame boundary ❌ [android-page] › page/locator-any-frame.spec.ts:325 › LO-031 should only search frames inside the starting frame ❌ [android-page] › page/locator-any-frame.spec.ts:337 › LO-032 should enter a frame found in a nested frame ❌ [android-page] › page/locator-any-frame.spec.ts:345 › LO-033 should click inside an entered frame ❌ [android-page] › page/locator-any-frame.spec.ts:355 › LO-034 should not search nested frames after entering a frame ❌ [android-page] › page/locator-any-frame.spec.ts:365 › LO-035 should support two frameLocators ❌ [android-page] › page/locator-any-frame.spec.ts:374 › LO-036 should support locator before frameLocator ❌ [android-page] › page/locator-any-frame.spec.ts:383 › LO-037 should support owner of a frameLocator ❌ [android-page] › page/locator-any-frame.spec.ts:391 › LO-038 should wait for the frame to enter to appear ❌ [android-page] › page/locator-any-frame.spec.ts:408 › LO-039 should fail when the frame to enter matches in multiple frames ❌ [android-page] › page/locator-any-frame.spec.ts:423 › LO-040 should support contentFrame ❌ [android-page] › page/locator-any-frame.spec.ts:431 › LO-041 should render frameLocator() in the locator description ❌ [android-page] › page/locator-any-frame.spec.ts:436 › LO-042 should not allow frameLocator() inside a composite locator ❌ [android-page] › page/locator-any-frame.spec.ts:461 › LO-043 should support a composite locator under frameLocator() ❌ [android-page] › page/locator-any-frame.spec.ts:469 › LO-044 should support a composite locator under frameLocator() and a frame locator ❌ [android-page] › page/locator-any-frame.spec.ts:478 › LO-045 should not allow first/last/nth on frameLocator() ❌ [android-page] › page/locator-any-frame.spec.ts:484 › LO-046 should not allow owner on frameLocator() ❌ [android-page] › page/locator-any-frame.spec.ts:489 › LO-047 should resolve aria-ref selectors ❌ [android-page] › page/locator-any-frame.spec.ts:501 › LO-048 should click while another iframe is stalled ❌ [android-page] › page/locator-any-frame.spec.ts:512 › LO-049 should support toBeVisible while another iframe is stalled ❌ [android-page] › page/locator-any-frame.spec.ts:521 › LO-050 should support toHaveCount while another iframe is stalled ❌ [android-page] › page/locator-any-frame.spec.ts:530 › LO-051 should treat elements inside hidden iframe as hidden ❌ [android-page] › page/locator-click.spec.ts:20 › LO-052 should work Radoslav Kirilov (@smoke) ❌ [android-page] › page/locator-click.spec.ts:27 › LO-053 should work with Node removed ❌ [android-page] › page/locator-click.spec.ts:35 › LO-054 should double click the button ❌ [android-page] › page/locator-click.spec.ts:50 › LO-055 should click if the target element is removed in pointerup event ❌ [android-page] › page/locator-click.spec.ts:57 › LO-056 should click if the target element is removed in pointerdown event ❌ [android-page] › page/locator-convenience.spec.ts:20 › LO-057 should have a nice preview ❌ [android-page] › page/locator-convenience.spec.ts:33 › LO-058 getAttribute should work ❌ [android-page] › page/locator-convenience.spec.ts:42 › LO-059 inputValue should work ❌ [android-page] › page/locator-convenience.spec.ts:61 › LO-060 innerHTML should work ❌ [android-page] › page/locator-convenience.spec.ts:68 › LO-061 innerText should work ❌ [android-page] › page/locator-convenience.spec.ts:75 › LO-062 innerText should throw ❌ [android-page] › page/locator-convenience.spec.ts:84 › LO-063 innerText should produce log ❌ [android-page] › page/locator-convenience.spec.ts:91 › LO-064 textContent should work ❌ [android-page] › page/locator-convenience.spec.ts:98 › LO-065 isEnabled and isDisabled should work ❌ [android-page] › page/locator-convenience.spec.ts:121 › LO-066 isEditable should work ❌ [android-page] › page/locator-convenience.spec.ts:148 › LO-067 isChecked should work ❌ [android-page] › page/locator-convenience.spec.ts:160 › LO-068 isChecked should work for indeterminate input ❌ [android-page] › page/locator-convenience.spec.ts:175 › LO-069 allTextContents should work ❌ [android-page] › page/locator-convenience.spec.ts:180 › LO-070 allInnerTexts should work ❌ [android-page] › page/locator-convenience.spec.ts:185 › LO-071 should return page ❌ [android-page] › page/locator-convenience.spec.ts:197 › LO-072 description should return null for locator without description ❌ [android-page] › page/locator-convenience.spec.ts:202 › LO-073 description should return description for locator with simple description ❌ [android-page] › page/locator-convenience.spec.ts:207 › LO-074 description should return description with special characters ❌ [android-page] › page/locator-convenience.spec.ts:212 › LO-075 description should return description for chained locators ❌ [android-page] › page/locator-convenience.spec.ts:217 › LO-076 description should return description for locator with multiple describe calls ❌ [android-page] › page/locator-convenience.spec.ts:226 › LO-077 toString() returns formatted locator ❌ [android-page] › page/locator-convenience.spec.ts:232 › LO-078 toString() prefers description ❌ [android-page] › page/locator-element-handle.spec.ts:20 › LO-079 should query existing element Radoslav Kirilov (@smoke) ❌ [android-page] › page/locator-element-handle.spec.ts:30 › LO-080 should query existing elements ❌ [android-page] › page/locator-element-handle.spec.ts:39 › LO-081 should return empty array for non-existing elements ❌ [android-page] › page/locator-element-handle.spec.ts:47 › LO-082 xpath should query existing element ❌ [android-page] › page/locator-element-handle.spec.ts:57 › LO-083 xpath should return null for non-existing element ❌ [android-page] › page/locator-evaluate.spec.ts:20 › LO-084 should work Radoslav Kirilov (@smoke) ❌ [android-page] › page/locator-evaluate.spec.ts:27 › LO-085 should retrieve content from subtree ❌ [android-page] › page/locator-evaluate.spec.ts:35 › LO-086 should work for all ❌ [android-page] › page/locator-evaluate.spec.ts:42 › LO-087 should retrieve content from subtree for all ❌ [android-page] › page/locator-evaluate.spec.ts:50 › LO-088 should not throw in case of missing selector for all ❌ [android-page] › page/locator-frame.spec.ts:69 › LO-089 should work for iframe Radoslav Kirilov (@smoke) ❌ [android-page] › page/locator-frame.spec.ts:79 › LO-090 should work for nested iframe ❌ [android-page] › page/locator-frame.spec.ts:89 › LO-091 should work for $ and $$ ❌ [android-page] › page/locator-frame.spec.ts:98 › LO-092 should wait for frame ❌ [android-page] › page/locator-frame.spec.ts:104 › LO-093 should wait for frame 2 ❌ [android-page] › page/locator-frame.spec.ts:110 › LO-094 should wait for frame to go ❌ [android-page] › page/locator-frame.spec.ts:119 › LO-095 should not wait for frame ❌ [android-page] › page/locator-frame.spec.ts:124 › LO-096 should not wait for frame 2 ❌ [android-page] › page/locator-frame.spec.ts:129 › LO-097 should not wait for frame 3 ❌ [android-page] › page/locator-frame.spec.ts:134 › LO-098 should click in lazy iframe ❌ [android-page] › page/locator-frame.spec.ts:167 › LO-099 waitFor should survive frame reattach ❌ [android-page] › page/locator-frame.spec.ts:181 › LO-100 click should survive frame reattach ❌ [android-page] › page/locator-frame.spec.ts:195 › LO-101 click should survive iframe navigation ❌ [android-page] › page/locator-frame.spec.ts:204 › LO-102 should non work for non-frame ❌ [android-page] › page/locator-frame.spec.ts:213 › LO-103 locator.frameLocator should work for iframe ❌ [android-page] › page/locator-frame.spec.ts:223 › LO-104 locator.frameLocator should throw on ambiguity ❌ [android-page] › page/locator-frame.spec.ts:231 › LO-105 locator.frameLocator should not throw on first/last/nth ❌ [android-page] › page/locator-frame.spec.ts:242 › LO-106 getBy coverage ❌ [android-page] › page/locator-frame.spec.ts:261 › LO-107 wait for hidden should succeed when frame is not in dom ❌ [android-page] › page/locator-frame.spec.ts:272 › LO-108 should work with COEP/COOP/CORP isolated iframe ❌ [android-page] › page/locator-frame.spec.ts:302 › LO-109 locator.contentFrame should work ❌ [android-page] › page/locator-frame.spec.ts:313 › LO-110 frameLocator.owner should work ❌ [android-page] › page/locator-frame.spec.ts:322 › LO-111 should treat elements inside hidden iframe as hidden ❌ [android-page] › page/locator-frame.spec.ts:351 › LO-112 should wait for hidden iframe to become visible ❌ [android-page] › page/locator-frame.spec.ts:371 › LO-113 should treat elements inside hidden cross-origin iframe as hidden ❌ [android-page] › page/locator-highlight.spec.ts:22 › LO-114 should highlight locator ❌ [android-page] › page/locator-is-visible.spec.ts:20 › LO-115 isVisible and isHidden should work ❌ [android-page] › page/locator-is-visible.spec.ts:39 › LO-116 isVisible should be true for opacity:0 ❌ [android-page] › page/locator-is-visible.spec.ts:44 › LO-117 isVisible should be true for element outside view ❌ [android-page] › page/locator-is-visible.spec.ts:49 › LO-118 isVisible and isHidden should work with details ❌ [android-page] › page/locator-is-visible.spec.ts:63 › LO-119 isVisible and isHidden should work with nested details ❌ [android-page] › page/locator-is-visible.spec.ts:78 › LO-120 isVisible and isHidden should work with unslotted content ❌ [android-page] › page/locator-is-visible.spec.ts:93 › LO-121 isVisible and isHidden should work with list box options ❌ [android-page] › page/locator-is-visible.spec.ts:112 › LO-122 isVisible inside a button ❌ [android-page] › page/locator-is-visible.spec.ts:125 › LO-123 isVisible inside a role=button ❌ [android-page] › page/locator-is-visible.spec.ts:138 › LO-124 isVisible during navigation should not throw ❌ [android-page] › page/locator-is-visible.spec.ts:151 › LO-125 isVisible with invalid selector should throw ❌ [android-page] › page/locator-list.spec.ts:19 › LO-126 locator.all should work ❌ [android-page] › page/locator-misc-1.spec.ts:21 › LO-127 should hover Radoslav Kirilov (@smoke) ❌ [android-page] › page/locator-misc-1.spec.ts:30 › LO-128 should hover when Node is removed ❌ [android-page] › page/locator-misc-1.spec.ts:40 › LO-129 should fill input ❌ [android-page] › page/locator-misc-1.spec.ts:47 › LO-130 should fill input when Node is removed ❌ [android-page] › page/locator-misc-1.spec.ts:55 › LO-131 should clear input ❌ [android-page] › page/locator-misc-1.spec.ts:64 › LO-132 should check the box ❌ [android-page] › page/locator-misc-1.spec.ts:71 › LO-133 should check the box using setChecked ❌ [android-page] › page/locator-misc-1.spec.ts:80 › LO-134 should uncheck the box ❌ [android-page] › page/locator-misc-1.spec.ts:87 › LO-135 should select single option ❌ [android-page] › page/locator-misc-1.spec.ts:95 › LO-136 should focus and blur a button ❌ [android-page] › page/locator-misc-1.spec.ts:120 › LO-137 focus should respect strictness ❌ [android-page] › page/locator-misc-1.spec.ts:126 › LO-138 should dispatch click event via ElementHandles ❌ [android-page] › page/locator-misc-1.spec.ts:133 › LO-139 should upload the file ❌ [android-page] › page/locator-misc-2.spec.ts:20 › LO-140 should press Radoslav Kirilov (@smoke) ❌ [android-page] › page/locator-misc-2.spec.ts:26 › LO-141 should scroll into view ❌ [android-page] › page/locator-misc-2.spec.ts:45 › LO-142 should scroll zero-sized element into view ❌ [android-page] › page/locator-misc-2.spec.ts:76 › LO-143 should select textarea ❌ [android-page] › page/locator-misc-2.spec.ts:84 › LO-144 should type ❌ [android-page] › page/locator-misc-2.spec.ts:90 › LO-145 should pressSequentially ❌ [android-page] › page/locator-misc-2.spec.ts:96 › LO-146 should take screenshot ❌ [android-page] › page/locator-misc-2.spec.ts:107 › LO-147 should return bounding box ❌ [android-page] › page/locator-misc-2.spec.ts:117 › LO-148 should waitFor ❌ [android-page] › page/locator-misc-2.spec.ts:126 › LO-149 should waitFor hidden ❌ [android-page] › page/locator-misc-2.spec.ts:134 › LO-150 should combine visible with other selectors ❌ [android-page] › page/locator-misc-2.spec.ts:148 › LO-151 should support filter(visible) ❌ [android-page] › page/locator-misc-2.spec.ts:164 › LO-152 should support visible() ❌ [android-page] › page/locator-misc-2.spec.ts:180 › LO-153 locator.count should work with deleted Map in main world ❌ [android-page] › page/locator-misc-2.spec.ts:187 › LO-154 Locator.locator() and FrameLocator.locator() should accept locator ❌ [android-page] › page/locator-misc-2.spec.ts:204 › LO-155 should fill programmatically enabled textarea ❌ [android-page] › page/locator-misc-2.spec.ts:221 › LO-156 press should throw on unknown keys ❌ [android-page] › page/locator-query.spec.ts:20 › LO-157 should respect first() and last() Radoslav Kirilov (@smoke) ❌ [android-page] › page/locator-query.spec.ts:33 › LO-158 should respect nth() ❌ [android-page] › page/locator-query.spec.ts:45 › LO-159 should throw on capture w/ nth() ❌ [android... 170120 more characters

@github-actions

Copy link
Copy Markdown
Contributor

🔴 The Firefox mouse test failure is caused by this PR

Hi, I'm the Playwright bot. I checked the completed CI reports for c8be5ff.

Details

The Firefox pointer-ID change needs a matching test update. The other failures are confirmed pre-existing: Android device failures and a Chromium video flake. This covers both the latest tests 2 report and the tests 1 report.

Caused by this PR

  • [firefox-page] › page/page-mouse.spec.ts:108 › MO-004 should pointerdown the div with a custom button — fails on Ubuntu, Windows, both macOS architectures, and with tracing, including all three retries: expected 0, received 1. This PR replaces DEFAULT_MOUSE_POINTER_ID with a positive per-page ID in TargetRegistry.js and PageHandler.js, but the assertion at line 137 still expects Firefox's event.pointerId to be 0. The same test passed in these configurations on base a6fb02f (Ubuntu, other configurations). Update the Firefox assertion to check the intended positive per-page ID rather than hard-coding 0.

Pre-existing flake / infra

  • Android: 2,199 failures in the Android job. The device disconnects (Device is closed), then setup fails with Cannot read properties of undefined (reading 'shell') or No devices found. After refreshing the results database, all 2,199 failing test identities also failed with device errors on main at 3eea037, before this PR, in run 41133778059. This PR does not change Android device handling.
  • [chromium-library] › library/video.spec.ts:762 › screencast › VI-030 should work with video+trace — no screencast frame is available, so reading frame.file throws. The same test on the same Ubuntu bot failed with the same error on main at 2fc0d9c in run 41080411125. Across 332 unrelated runs in the refreshed database, it failed after retries in 25 and passed in 307. This PR does not change Chromium recording.

Triaged by the Playwright bot - agent run

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants