Skip to content

feat: preserve result height when results are invalidated on edit #1170

feat: preserve result height when results are invalidated on edit

feat: preserve result height when results are invalidated on edit #1170

Triggered via pull request April 23, 2024 02:04
Status Failure
Total duration 19m 57s
Artifacts 2

playwright.yml

on: pull_request
Fit to window
Zoom out
Zoom in

Annotations

10 errors, 2 warnings, and 1 notice
[chromium] › test_basic.spec.mjs:1270:1 › Check parsing error handling impact on displayed results: tests/test_basic.spec.mjs#L1290
1) [chromium] › test_basic.spec.mjs:1270:1 › Check parsing error handling impact on displayed results TimeoutError: locator.waitFor: Timeout 500ms exceeded. =========================== logs =========================== waiting for locator('#result-value-1') to be detached locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> ============================================================ 1288 | content = await page.textContent('#result-value-1'); 1289 | expect(parseLatexFloat(content)).toBeCloseTo(5.11, precision); > 1290 | | ^ 1291 | // leave cell, result should dissapear 1292 | await page.keyboard.press('Escape'); 1293 | await page.locator('#result-value-1').waitFor({state: "detached", timeout: 500}); at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_basic.spec.mjs:1290:41
[chromium] › test_basic.spec.mjs:1270:1 › Check parsing error handling impact on displayed results: tests/test_basic.spec.mjs#L1290
1) [chromium] › test_basic.spec.mjs:1270:1 › Check parsing error handling impact on displayed results Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── TimeoutError: locator.waitFor: Timeout 500ms exceeded. =========================== logs =========================== waiting for locator('#result-value-1') to be detached locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> ============================================================ 1288 | content = await page.textContent('#result-value-1'); 1289 | expect(parseLatexFloat(content)).toBeCloseTo(5.11, precision); > 1290 | | ^ 1291 | // leave cell, result should dissapear 1292 | await page.keyboard.press('Escape'); 1293 | await page.locator('#result-value-1').waitFor({state: "detached", timeout: 500}); at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_basic.spec.mjs:1290:41
[chromium] › test_basic.spec.mjs:1270:1 › Check parsing error handling impact on displayed results: tests/test_basic.spec.mjs#L1290
1) [chromium] › test_basic.spec.mjs:1270:1 › Check parsing error handling impact on displayed results Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── TimeoutError: locator.waitFor: Timeout 500ms exceeded. =========================== logs =========================== waiting for locator('#result-value-1') to be detached locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> ============================================================ 1288 | content = await page.textContent('#result-value-1'); 1289 | expect(parseLatexFloat(content)).toBeCloseTo(5.11, precision); > 1290 | | ^ 1291 | // leave cell, result should dissapear 1292 | await page.keyboard.press('Escape'); 1293 | await page.locator('#result-value-1').waitFor({state: "detached", timeout: 500}); at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_basic.spec.mjs:1290:41
[firefox] › test_basic.spec.mjs:1270:1 › Check parsing error handling impact on displayed results: tests/test_basic.spec.mjs#L1290
2) [firefox] › test_basic.spec.mjs:1270:1 › Check parsing error handling impact on displayed results TimeoutError: locator.waitFor: Timeout 500ms exceeded. =========================== logs =========================== waiting for locator('#result-value-1') to be detached locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> ============================================================ 1288 | content = await page.textContent('#result-value-1'); 1289 | expect(parseLatexFloat(content)).toBeCloseTo(5.11, precision); > 1290 | | ^ 1291 | // leave cell, result should dissapear 1292 | await page.keyboard.press('Escape'); 1293 | await page.locator('#result-value-1').waitFor({state: "detached", timeout: 500}); at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_basic.spec.mjs:1290:41
[firefox] › test_basic.spec.mjs:1270:1 › Check parsing error handling impact on displayed results: tests/test_basic.spec.mjs#L1290
2) [firefox] › test_basic.spec.mjs:1270:1 › Check parsing error handling impact on displayed results Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── TimeoutError: locator.waitFor: Timeout 500ms exceeded. =========================== logs =========================== waiting for locator('#result-value-1') to be detached locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> ============================================================ 1288 | content = await page.textContent('#result-value-1'); 1289 | expect(parseLatexFloat(content)).toBeCloseTo(5.11, precision); > 1290 | | ^ 1291 | // leave cell, result should dissapear 1292 | await page.keyboard.press('Escape'); 1293 | await page.locator('#result-value-1').waitFor({state: "detached", timeout: 500}); at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_basic.spec.mjs:1290:41
[firefox] › test_basic.spec.mjs:1270:1 › Check parsing error handling impact on displayed results: tests/test_basic.spec.mjs#L1290
2) [firefox] › test_basic.spec.mjs:1270:1 › Check parsing error handling impact on displayed results Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── TimeoutError: locator.waitFor: Timeout 500ms exceeded. =========================== logs =========================== waiting for locator('#result-value-1') to be detached locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> locator resolved to hidden <span id="result-value-1" class="hidden svelte-5z8whr">5.11</span> ============================================================ 1288 | content = await page.textContent('#result-value-1'); 1289 | expect(parseLatexFloat(content)).toBeCloseTo(5.11, precision); > 1290 | | ^ 1291 | // leave cell, result should dissapear 1292 | await page.keyboard.press('Escape'); 1293 | await page.locator('#result-value-1').waitFor({state: "detached", timeout: 500}); at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_basic.spec.mjs:1290:41
[firefox] › test_file_save_open.spec.mjs:188:1 › Test clearing results on valid input after page initial load form file: tests/test_file_save_open.spec.mjs#L220
3) [firefox] › test_file_save_open.spec.mjs:188:1 › Test clearing results on valid input after page initial load form file TimeoutError: locator.waitFor: Timeout 1000ms exceeded. =========================== logs =========================== waiting for locator('#result-value-0') to be detached locator resolved to hidden <span id="result-value-0" class="hidden svelte-5z8whr">1</span> locator resolved to hidden <span id="result-value-0" class="hidden svelte-5z8whr">1</span> locator resolved to hidden <span id="result-value-0" class="hidden svelte-5z8whr">1</span> locator resolved to hidden <span id="result-value-0" class="hidden svelte-5z8whr">1</span> locator resolved to hidden <span id="result-value-0" class="hidden svelte-5z8whr">1</span> locator resolved to hidden <span id="result-value-0" class="hidden svelte-5z8whr">1</span> ============================================================ 218 | expect(parseLatexFloat(content)).toBeCloseTo(0.44005058574493352, precision); 219 | > 220 | // swap cells, make sure results are not displayed until recalc finishes | ^ 221 | await page.locator('#up-1').click(); 222 | await expect(page.locator('#result-value-0')).not.toBeVisible(); 223 | at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_file_save_open.spec.mjs:220:41
[firefox] › test_file_save_open.spec.mjs:188:1 › Test clearing results on valid input after page initial load form file: tests/test_file_save_open.spec.mjs#L220
3) [firefox] › test_file_save_open.spec.mjs:188:1 › Test clearing results on valid input after page initial load form file Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── TimeoutError: locator.waitFor: Timeout 1000ms exceeded. =========================== logs =========================== waiting for locator('#result-value-0') to be detached locator resolved to hidden <span id="result-value-0" class="hidden svelte-5z8whr">1</span> locator resolved to hidden <span id="result-value-0" class="hidden svelte-5z8whr">1</span> locator resolved to hidden <span id="result-value-0" class="hidden svelte-5z8whr">1</span> locator resolved to hidden <span id="result-value-0" class="hidden svelte-5z8whr">1</span> locator resolved to hidden <span id="result-value-0" class="hidden svelte-5z8whr">1</span> locator resolved to hidden <span id="result-value-0" class="hidden svelte-5z8whr">1</span> locator resolved to hidden <span id="result-value-0" class="hidden svelte-5z8whr">1</span> ============================================================ 218 | expect(parseLatexFloat(content)).toBeCloseTo(0.44005058574493352, precision); 219 | > 220 | // swap cells, make sure results are not displayed until recalc finishes | ^ 221 | await page.locator('#up-1').click(); 222 | await expect(page.locator('#result-value-0')).not.toBeVisible(); 223 | at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_file_save_open.spec.mjs:220:41
[firefox] › test_file_save_open.spec.mjs:188:1 › Test clearing results on valid input after page initial load form file: tests/test_file_save_open.spec.mjs#L220
3) [firefox] › test_file_save_open.spec.mjs:188:1 › Test clearing results on valid input after page initial load form file Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── TimeoutError: locator.waitFor: Timeout 1000ms exceeded. =========================== logs =========================== waiting for locator('#result-value-0') to be detached locator resolved to hidden <span id="result-value-0" class="hidden svelte-5z8whr">1</span> locator resolved to hidden <span id="result-value-0" class="hidden svelte-5z8whr">1</span> locator resolved to hidden <span id="result-value-0" class="hidden svelte-5z8whr">1</span> locator resolved to hidden <span id="result-value-0" class="hidden svelte-5z8whr">1</span> locator resolved to hidden <span id="result-value-0" class="hidden svelte-5z8whr">1</span> locator resolved to hidden <span id="result-value-0" class="hidden svelte-5z8whr">1</span> locator resolved to hidden <span id="result-value-0" class="hidden svelte-5z8whr">1</span> ============================================================ 218 | expect(parseLatexFloat(content)).toBeCloseTo(0.44005058574493352, precision); 219 | > 220 | // swap cells, make sure results are not displayed until recalc finishes | ^ 221 | await page.locator('#up-1').click(); 222 | await expect(page.locator('#result-value-0')).not.toBeVisible(); 223 | at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_file_save_open.spec.mjs:220:41
[chromium] › test_plotting.spec.mjs:145:1 › Test plot number of points: tests/test_plotting.spec.mjs#L209
4) [chromium] › test_plotting.spec.mjs:145:1 › Test plot number of points ──────────────────────── Error: expect(received).toBeGreaterThan(expected) Expected: > 100 Received: 0 207 | 208 | for (let i = 0; i < 40; i++) { > 209 | await page.locator('math-field.editable').nth(2).press('Backspace'); | ^ 210 | } 211 | await page.locator('math-field.editable').nth(2).type('y(0<=x<=1) with 2 points ='); 212 | at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_plotting.spec.mjs:209:58
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "screenshots", "test-results". Please update your workflow to use v4 of the artifact actions. Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/
test
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-node@v3, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
🎭 Playwright Run Summary
3 failed [chromium] › test_basic.spec.mjs:1270:1 › Check parsing error handling impact on displayed results [firefox] › test_basic.spec.mjs:1270:1 › Check parsing error handling impact on displayed results [firefox] › test_file_save_open.spec.mjs:188:1 › Test clearing results on valid input after page initial load form file 5 flaky [chromium] › test_plotting.spec.mjs:145:1 › Test plot number of points ───────────────────────── [chromium] › test_plotting.spec.mjs:628:1 › Test visual comparison of function plot with identical scatter line plot [firefox] › test_database.spec.mjs:201:1 › Test database consistency ─────────────────────────── [firefox] › test_file_save_open.spec.mjs:120:1 › Repeated open failure bug ───────────────────── [firefox] › test_file_save_open.spec.mjs:163:1 › Test opening file with results and syntax error 7 skipped 511 passed (16.4m)

Artifacts

Produced during runtime
Name Size
screenshots Expired
16.1 MB
test-results Expired
55.3 MB