Skip to content

Conversation

@qw-in
Copy link
Member

@qw-in qw-in commented Dec 9, 2025

Here I've introduced Playwright & some screenshot testing. My hope is that as I (we) start to make changes this is a relatively low-effort way to guarantee I don't introduce regressions. It remains to be seen if the screenshots will help or just get in the way!

I'd like to try this for a while and at least see how useful/painful it is. I've tried my best to tune it to run in a reasonable time and not have too many false positives but time will tell.

If it seems like its a positive change, we could look at making it a required test, running against the vercel preview, etc.

If we don't like the screenshot test I can rip that out of this PR. It just seemed difficult to validate the playwright configuration and GitHub action without a test that does something.

cc @davidmytton @wooorm-arcjet as you both are working here quite regularly!

Closes ENG-201

@qw-in qw-in self-assigned this Dec 9, 2025
@vercel
Copy link

vercel bot commented Dec 9, 2025

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Preview Comments Updated (UTC)
arcjet-docs Ready Ready Preview Comment Dec 10, 2025 4:03pm

@socket-security
Copy link

socket-security bot commented Dec 9, 2025

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

Diff Package Supply Chain
Security
Vulnerability Quality Maintenance License
Updated@​playwright/​test@​1.56.0 ⏵ 1.57.010010010099100
Updatedplaywright@​1.56.0 ⏵ 1.57.0100 +110010099100

View full report

@qw-in qw-in marked this pull request as ready for review December 9, 2025 23:02
@qw-in qw-in requested a review from a team as a code owner December 9, 2025 23:02
Copy link
Member

@wooorm-arcjet wooorm-arcjet left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good to me, not sure if you want someone else to review too.
as you say, we can always tweak later!

@qw-in qw-in merged commit 83c7e8e into main Dec 10, 2025
5 checks passed
@qw-in qw-in deleted the quinn/eng-201-introduce-playwright-for-baseline-integration-testing branch December 10, 2025 17:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants