Skip to content

refactor: perform dimensional analysis and numerical evaluation in same pass (WIP) #1568

refactor: perform dimensional analysis and numerical evaluation in same pass (WIP)

refactor: perform dimensional analysis and numerical evaluation in same pass (WIP) #1568

Triggered via pull request January 8, 2025 06:16
Status Success
Total duration 23m 55s
Artifacts 2

playwright.yml

on: pull_request
Fit to window
Zoom out
Zoom in

Annotations

9 errors, 1 warning, and 1 notice
[chromium] › test_complex.spec.mjs:239:1 › Test abs function with imaginary numbers and units: tests/test_complex.spec.mjs#L265
1) [chromium] › test_complex.spec.mjs:239:1 › Test abs function with imaginary numbers and units ─ Error: expect(received).toBeCloseTo(expected, precision) Expected: 1 Received: NaN Expected precision: 13 Expected difference: < 0.00000000000005 Received difference: NaN 263 | 264 | let content = await page.textContent('#result-value-2'); > 265 | expect(parseLatexFloat(content)).toBeCloseTo(1, precision); | ^ 266 | content = await page.textContent('#result-units-2'); 267 | expect(content).toBe(''); 268 | at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_complex.spec.mjs:265:36
[chromium] › test_custom_base_units.spec.mjs:269:1 › Test user default config: tests/test_custom_base_units.spec.mjs#L360
2) [chromium] › test_custom_base_units.spec.mjs:269:1 › Test user default config ───────────────── TimeoutError: page.textContent: Timeout 120000ms exceeded. Call log: - waiting for locator('#result-value-0') 358 | await page.waitForSelector('text=Updating...', {state: 'detached'}); 359 | > 360 | content = await page.textContent('#result-value-0'); | ^ 361 | expect(parseLatexFloat(content)).toBeCloseTo(3, precision); 362 | content = await page.textContent('#result-units-0'); 363 | expect(content).toBe('m'); at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_custom_base_units.spec.mjs:360:24
[chromium] › test_plotting.spec.mjs:153:1 › Test plot number of points: tests/test_plotting.spec.mjs#L225
3) [chromium] › test_plotting.spec.mjs:153:1 › Test plot number of points ──────────────────────── Error: expect(received).toEqual(expected) // deep equality Expected: 0 Received: 3422 223 | 224 | expect(compareImages(linearImageFile, curveImageFile)).toBeGreaterThan(100); > 225 | expect(compareImages(linearImageFile, twoPointCurveImageFile)).toEqual(0); | ^ 226 | }); 227 | 228 | at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_plotting.spec.mjs:225:66
[chromium] › test_plotting.spec.mjs:153:1 › Test plot number of points: tests/test_plotting.spec.mjs#L225
3) [chromium] › test_plotting.spec.mjs:153:1 › Test plot number of points ──────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(received).toEqual(expected) // deep equality Expected: 0 Received: 3422 223 | 224 | expect(compareImages(linearImageFile, curveImageFile)).toBeGreaterThan(100); > 225 | expect(compareImages(linearImageFile, twoPointCurveImageFile)).toEqual(0); | ^ 226 | }); 227 | 228 | at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_plotting.spec.mjs:225:66
[firefox] › test_basic.spec.mjs:1272:1 › Check parsing error handling impact on displayed results: tests/test_basic.spec.mjs#L1283
4) [firefox] › test_basic.spec.mjs:1272:1 › Check parsing error handling impact on displayed results Error: expect(received).toBeCloseTo(expected, precision) Expected: 5.11 Received: NaN Expected precision: 13 Expected difference: < 0.00000000000005 Received difference: NaN 1281 | // check query result in cell 1 1282 | let content = await page.textContent('#result-value-1'); > 1283 | expect(parseLatexFloat(content)).toBeCloseTo(5.11, precision); | ^ 1284 | 1285 | // create a syntax error in cell 2, should still see result 1286 | await page.locator('#cell-2 >> math-field.editable').type('a'); at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_basic.spec.mjs:1283:36
[firefox] › test_calc.spec.mjs:417:1 › Test derivative dimensional analysis bug: tests/test_calc.spec.mjs#L422
5) [firefox] › test_calc.spec.mjs:417:1 › Test derivative dimensional analysis bug ─────────────── TimeoutError: page.textContent: Timeout 120000ms exceeded. Call log: - waiting for locator('#result-value-0') 420 | await page.waitForSelector('.status-footer', {state: 'detached'}); 421 | > 422 | let content = await page.textContent('#result-value-0'); | ^ 423 | expect(parseLatexFloat(content)).toBeCloseTo(1, precision); 424 | content = await page.textContent('#result-units-0'); 425 | expect(content).toBe(''); at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_calc.spec.mjs:422:28
[firefox] › test_file_save_open.spec.mjs:138:1 › Test opening file with results and syntax error: tests/test_file_save_open.spec.mjs#L147
6) [firefox] › test_file_save_open.spec.mjs:138:1 › Test opening file with results and syntax error Error: fileChooser.setFiles: Test ended. 145 | const path = "tests/test_sheet_parsing_error.epxyz"; 146 | page.on('filechooser', async (fileChooser) => { > 147 | await fileChooser.setFiles(path); | ^ 148 | }); 149 | await page.locator('#open-sheet').click(); 150 | at Page.<anonymous> (/home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_file_save_open.spec.mjs:147:5)
[firefox] › test_matrix_addition.spec.mjs:104:1 › Incompatible size addition: tests/test_matrix_addition.spec.mjs#L109
7) [firefox] › test_matrix_addition.spec.mjs:104:1 › Incompatible size addition ────────────────── Error: Timed out 10000ms waiting for expect(locator).toBeVisible() Locator: locator('.status-footer').locator('text=ShapeError') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 10000ms - waiting for locator('.status-footer').locator('text=ShapeError') 107 | await page.waitForSelector('text=Updating...', {state: 'detached'}); 108 | > 109 | await expect(page.locator('.status-footer >> text=ShapeError')).toBeVisible(); | ^ 110 | }); 111 | 112 | test('nonsquare addition', async () => { at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_matrix_addition.spec.mjs:109:67
[firefox] › test_matrix_multiplication.spec.mjs:124:1 › Units with square multiplication: tests/test_matrix_multiplication.spec.mjs#L129
8) [firefox] › test_matrix_multiplication.spec.mjs:124:1 › Units with square multiplication ────── TimeoutError: page.textContent: Timeout 120000ms exceeded. Call log: - waiting for locator('#result-value-0') 127 | await page.waitForSelector('text=Updating...', {state: 'detached'}); 128 | > 129 | let content = await page.textContent(`#result-value-0`); | ^ 130 | expect(content).toBe('\\begin{bmatrix} 5 \\cdot a + 7 \\cdot b & 6 \\cdot a + 8 \\cdot b \\\\ 5 \\cdot c + 7 \\cdot d & 6 \\cdot c + 8 \\cdot d \\end{bmatrix}'); 131 | 132 | // add some numbers for variables that define first matrix at /home/runner/work/EngineeringPaper.xyz/EngineeringPaper.xyz/tests/test_matrix_multiplication.spec.mjs:129:28
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "screenshots", "test-results". Please update your workflow to use v4 of the artifact actions. Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/
🎭 Playwright Run Summary
8 flaky [chromium] › test_complex.spec.mjs:239:1 › Test abs function with imaginary numbers and units ── [chromium] › test_custom_base_units.spec.mjs:269:1 › Test user default config ────────────────── [chromium] › test_plotting.spec.mjs:153:1 › Test plot number of points ───────────────────────── [firefox] › test_basic.spec.mjs:1272:1 › Check parsing error handling impact on displayed results [firefox] › test_calc.spec.mjs:417:1 › Test derivative dimensional analysis bug ──────────────── [firefox] › test_file_save_open.spec.mjs:138:1 › Test opening file with results and syntax error [firefox] › test_matrix_addition.spec.mjs:104:1 › Incompatible size addition ─────────────────── [firefox] › test_matrix_multiplication.spec.mjs:124:1 › Units with square multiplication ─────── 9 skipped 763 passed (20.4m)

Artifacts

Produced during runtime
Name Size
screenshots
15.9 MB
test-results Expired
176 MB