Browsertrix Cloud v1.9.0-beta.0

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.9.0-beta.0/browsertrix-cloud-v1.9.0-beta.0.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• Adds a link to the new ReplayWebpage replay issue form in GitHub by @Shrinks99 in #1404
• Refactor LiteElement into reactive controllers by @SuaYoo in #1423
• Add extra and gifted execution minutes by @tw4l in #1361
• Fix UI not updating after quota is reached by @SuaYoo in #1425
• Fix dashboard usage history off-by-one labels by @tw4l in #1431
• Fix attribute casing & lit-analyzer issues by @emma-sg in #1429
• Add bundle analyzer script by @emma-sg in #1437
• Fix runtime error on log out by @SuaYoo in #1439
• Only load webpack-bundle-analyzer if BUNDLE_ANALYZER env var is present by @emma-sg in #1446
• Fix fetch helper by @SuaYoo in #1442
• Recreate configmaps if missing by @ikreymer in #1444
• Fix redirect to login page by @SuaYoo in #1445
• Use execution duration formatter in table view by @emma-sg in #1449
• Improve frontend event system by @SuaYoo in #1450
• Org settings layout fix + misc styling & consistency improvements by @emma-sg in #1427
• Set runNow to false when editing existing workflows by @tw4l in #1458
• Improvements to collection creation and editing flow by @SuaYoo in #1424

Full Changelog: v1.8.1...v1.9.0-beta.0

Browsertrix Cloud v1.8.1

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.8.1/browsertrix-cloud-v1.8.1.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• Fixes allowed actions for viewers and crawlers throughout the app by @Shrinks99 in #1326
• Refactor components index file by @emma-sg in #1381
• Fix org settings help and info text by @SuaYoo in #1402
• Move execution time formatting into its own util by @emma-sg in #1386
• Prompt user to confirm workflow crawl deletion by @SuaYoo in #1401
• ESLint & Typescript fixes by @emma-sg in #1407
• Fix crawl list action menu positioning by @SuaYoo in #1399
• Move fork-ts-checker-webpack-plugin into dependencies by @emma-sg in #1410
• Add API tests for browser profiles by @tw4l in #1392
• Fix failing builds on main (btrix-microk8s-test) by @emma-sg in #1413
• Organize components into folders by function by @emma-sg in #1411
• Refactor API fetch helper into controller by @SuaYoo in #1415
• Add API endpoint to retry all failed bg jobs by @tw4l in #1396

Full Changelog: v1.8.0...v1.8.1

Browsertrix Cloud v1.8.0

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.8.0/browsertrix-cloud-v1.8.0.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

Major Updates

• Access organization pages via slugs instead of UUIDs in URLs
• Improved login system, including detection of invalid login attempts
• Display execution history in table + support for execution minute quotas.
• Support for multiple storages and replication via background jobs
• Additional webhooks for deletion operations
• Show 'Stopped' (or Stopped: Time Quota Reached) status messages when a crawl is stopped prematurely by user or due to quota constraints, replacing Partial Complete
• Dynamic exclusions: Pages can be excluded quickly without requiring crawler restart.
• New configurable email templates with HTML support
• User Guide Update

What's Changed

• Use org slug in place of UUIDs in app URLs by @SuaYoo in #1277
• User refactor + remove fastapi_users dependency + update fastapi by @ikreymer in #1290
• Make URLs in the settings viewer clickable, removes deeplinked titles by @Shrinks99 in #1247
• avoid exception if 'errors' key doesn't exist by @ikreymer in #1301
• Update README features link to new landing site by @tw4l in #1302
• Update user names in crawls and workflows after username update by @tw4l in #1299
• Prevent user from logging in after 5 consecutive failed login attempts until pw is reset by @tw4l in #1281
• Update tag spacing and styling for remove button by @Shrinks99 in #1283
• Display crawl time usage history table by @SuaYoo in #1304
• Provide full resources in archived items finished webhooks by @tw4l in #1308
• Frontend typo fixes by @ikreymer in #1315
• More stringent UUID types for user input / avoid 500 errors by @ikreymer in #1309
• Check for empty string for SMTP password by @tw4l in #1317
• Enforce quota and hard cap for monthly execution minutes by @tw4l in #1284
• Adds to org dashboard table by @Shrinks99 in #1311
• Storage Refactor: Replication + Custom Storage Support by @ikreymer in #1296
• Fix z-index footer issue in crawl workflow form by @Shrinks99 in #1313
• users: add case-insensitive index to maintain backwards compatibility… by @ikreymer in #1319
• fix regression in concurrent crawls: by @ikreymer in #1324
• Additional Type Hints / Type Fix Pass by @ikreymer in #1320
• Background Jobs Work by @ikreymer in #1321
• correctly suffix Auth-Signer url when running in custom namespace by @fservida in #1335
• Allow User to specify custom cluster-issuer by @fservida in #1332
• exclusion optimizations: dynamic exclusions (part of #1216): by @ikreymer in #1268
• Move backend app templates to be installed from configmap volume by @ikreymer in #1331
• Crawl Timeout via elapsed time by @ikreymer in #1338
• Add checkmark next to replicated/backed up files by @tw4l in #1343
• background jobs fix: ensure bucket is parsed correctly by @ikreymer in #1359
• charts cleanup: by @ikreymer in #1360
• Send email to superuser when background job fails by @tw4l in #1355
• Encode the collection sharing URL by @Shrinks99 in #1362
• Regression fix: add profiles/ prefix to profile filenames by @tw4l in #1365
• Implement retry API endpoint for failed background jobs by @tw4l in #1356
• Add crawl, upload, and collection delete webhook event notifications by @tw4l in #1363
• node affinity: set to required instead of preferred to keep crawlers on dedicated infrastructure by @ikreymer in #1366
• Minor capitalization fixes for workflow options by @Shrinks99 in #1374
• Update execution time display by @emma-sg in #1373
• Replace partial_complete -> stopped_by_user or stopped_quota_reached + operator edge cases by @ikreymer in #1368
• Remove collection share access column header icon by @Shrinks99 in #1371
• Email Templates by @ikreymer in #1375
• Improves user documentation intro by @Shrinks99 in #1376

New Contributors

• @fservida made their first contribution in #1335
• @emma-sg made their first contribution in #1373

Full Changelog: v1.7.1...v1.8.0

Browsertrix Cloud 1.8.0 Beta 4

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.8.0-beta.4/browsertrix-cloud-v1.8.0-beta.4.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• node affinity: set to required instead of preferred to keep crawlers on dedicated infrastructure by @ikreymer in #1366
• Minor capitalization fixes for workflow options by @Shrinks99 in #1374
• Update execution time display by @emma-sg in #1373
• Replace partial_complete -> stopped_by_user or stopped_quota_reached + operator edge cases by @ikreymer in #1368
• Remove collection share access column header icon by @Shrinks99 in #1371

New Contributors

• @emma-sg made their first contribution in #1373

Full Changelog: v1.8.0-beta.3...v1.8.0-beta.4

Browsertrix Cloud 1.8.0 Beta 3

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.8.0-beta.3/browsertrix-cloud-v1.8.0-beta.3.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• Add checkmark next to replicated/backed up files by @tw4l in #1343
• background jobs fix: ensure bucket is parsed correctly by @ikreymer in #1359
• charts cleanup: by @ikreymer in #1360
• Send email to superuser when background job fails by @tw4l in #1355
• Encode the collection sharing URL by @Shrinks99 in #1362
• Regression fix: add profiles/ prefix to profile filenames by @tw4l in #1365
• Implement retry API endpoint for failed background jobs by @tw4l in #1356
• Add crawl, upload, and collection delete webhook event notifications by @tw4l in #1363

Full Changelog: v1.8.0-beta.2...v1.8.0-beta.3

Browsertrix Cloud Beta 1.8.0 Beta 2

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.8.0-beta.2/browsertrix-cloud-v1.8.0-beta.2.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• fix regression in concurrent crawls: by @ikreymer in #1324
• Additional Type Hints / Type Fix Pass by @ikreymer in #1320
• Background Jobs Work by @ikreymer in #1321
• correctly suffix Auth-Signer url when running in custom namespace by @fservida in #1335
• Allow User to specify custom cluster-issuer by @fservida in #1332
• exclusion optimizations: dynamic exclusions (part of #1216): by @ikreymer in #1268
• Move backend app templates to be installed from configmap volume by @ikreymer in #1331
• Crawl Timeout via elapsed time by @ikreymer in #1338

New Contributors

• @fservida made their first contribution in #1335

Full Changelog: v1.8.0-beta.1...v1.8.0-beta.2

Browsertrix Cloud 1.8.0 Beta 1

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.8.0-beta.1/browsertrix-cloud-v1.8.0-beta.1.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• Frontend typo fixes by @ikreymer in #1315
• More stringent UUID types for user input / avoid 500 errors by @ikreymer in #1309
• Check for empty string for SMTP password by @tw4l in #1317
• Enforce quota and hard cap for monthly execution minutes by @tw4l in #1284
• Adds to org dashboard table by @Shrinks99 in #1311
• Storage Refactor: Replication + Custom Storage Support by @ikreymer in #1296
• Fix z-index footer issue in crawl workflow form by @Shrinks99 in #1313
• users: add case-insensitive index to maintain backwards compatibility… by @ikreymer in #1319

Full Changelog: v1.8.0-beta.0...v1.8.0-beta.1

Browsertrix Cloud 1.8.0 Beta 0

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.8.0-beta.0/browsertrix-cloud-v1.8.0-beta.0.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• Use org slug in place of UUIDs in app URLs by @SuaYoo in #1277
• User refactor + remove fastapi_users dependency + update fastapi by @ikreymer in #1290
• Make URLs in the settings viewer clickable, removes deeplinked titles by @Shrinks99 in #1247
• avoid exception if 'errors' key doesn't exist by @ikreymer in #1301
• Update README features link to new landing site by @tw4l in #1302
• Update user names in crawls and workflows after username update by @tw4l in #1299
• Prevent user from logging in after 5 consecutive failed login attempts until pw is reset by @tw4l in #1281
• Update tag spacing and styling for remove button by @Shrinks99 in #1283
• Display crawl time usage history table by @SuaYoo in #1304
• Provide full resources in archived items finished webhooks by @tw4l in #1308

Full Changelog: v1.7.0...v1.8.0-beta.0

Browsertrix Cloud v1.7.1

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.7.1/browsertrix-cloud-v1.7.1.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• avoid exception if 'errors' key doesn't exist (for 1.7.1 release) by @ikreymer in #1300

Full Changelog: v1.7.0...v1.7.1

Browsertrix Cloud v1.7.0

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.7.0/browsertrix-cloud-v1.7.0.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• Add and enforce org maxPagesPerCrawl quota by @tw4l in #1044
• ingress: minor tweaks to ingress to update to latest spec: by @ikreymer in #1096
• Use Shared Services for Crawling, Redis, Profile Browsers by @ikreymer in #1088
• feat: implement collections array with names for archived item details by @Chickensoupwithrice in #1098
• 1.6.3 Fixes - Fix sort order for Latest Crawl + 'Remove From Collection' action menu on archived items in collections by @ikreymer in #1113
• Add max crawl size option to backend and frontend by @tw4l in #1045
• dev: GitHub Issue form update: updates "user story" title by @Shrinks99 in #1112
• Add support for collectionIds to archived item PATCH endpoints by @tw4l in #1121
• publish helm chart on release (fixes #1114) (#1117) by @ikreymer in #1123
• Fix unsetting all collections via PATCH update by @tw4l in #1126
• Add event webhook notifications system to backend by @tw4l in #1061
• fix: Terminology unification "crawls" & "archive data" → "items" by @Shrinks99 in #1127
• fix: add "v" to helm chart release filename by @Chickensoupwithrice in #1141
• feat: init k3s ansible playbook by @Chickensoupwithrice in #1071
• Manage collection from archived item details by @SuaYoo in #1085
• supports overriding the replayweb.page version without having to be r… by @ikreymer in #1122
• Use base10 for sizes in frontend by @tw4l in #1133
• Fix too many request errors in UI by @SuaYoo in #1130
• null check: check before accessing config in 'get_all_crawl_search_values' by @ikreymer in #1144
• fix: "crawls" → "items" in collection add component by @Shrinks99 in #1145
• Better Resource settings per number of browsers by @ikreymer in #1103
• chart: move minio credentials to separate secret by @ikreymer in #1143
• Print crawl log to operator log (mostly for testing) by @ikreymer in #1148
• Add operator logs to nightly tests by @tw4l in #1150
• Add and enforce org storage quota by @tw4l in #1106
• ingress: simplify ingress config: (fixes #1135) by @ikreymer in #1146
• Fix 0015 migration by @ikreymer in #1154
• feat: add SMTP {port, use_tls} config by @Chickensoupwithrice in #1142
• Operator refactor to control pods + pvcs directly instead of statefulsets by @ikreymer in #1149
• Issue all non-upload storage-quota-update events from LiteElement by @tw4l in #1151
• Scheduled Crawl Refactor: Handle via Operator + Add Skipped Crawls on Quota Reached by @ikreymer in #1162
• Expect that crawl deleted response is bool, not int by @tw4l in #1170
• Add event webhook tests by @tw4l in #1155
• Make improvements to reset command by @tw4l in #1160
• type fix: ensure max crawl size and max crawl timeout values are set to 0 instead of null by @ikreymer in #1167
• Fix crawl scope help text by @SuaYoo in #1169
• Refactor / Cleanup: move ops functions back into classes by @ikreymer in #1171
• Improved type checking for backend with mypy by @ikreymer in #1174
• Increase wait to 30 seconds to ensure webhooks are sent by @tw4l in #1173
• Rename "Production" to "Remote" by @Chickensoupwithrice in #1105
• Enable saving individual collection form sections by @SuaYoo in #1166
• Implement sync streaming for finished crawl logs by @tw4l in #1168
• Reset crawl state to running when any crawlers are running (after post-process states) by @ikreymer in #1179
• version: bump RWP version to 1.8.12 by @ikreymer in #1181
• Remove config from list endpoints to speed up responses by @tw4l in #1193
• Call runNow when editing a crawlConfig by @Chickensoupwithrice in #1200
• Add org metrics API endpoint by @tw4l in #1196
• Separate "run now" switch from scheduling options by @SuaYoo in #1175
• New org home page dashboard by @SuaYoo in #1201
• Always display Download Logs button in crawl Logs tab by @tw4l in #1209
• Track bytes stored per file type and include in org metrics by @tw4l in #1207
• Small Microk8s Ansible Fixes by @Chickensoupwithrice in #1189
• default page limit: set limit to 50k pages by default by @ikreymer in #1211
• Limit Exclusion Matching to first page, add pagination by @ikreymer in #1214
• Show org storage quotas in dashboard by @SuaYoo in #1210
• Move DO ansible playbook to new format by @Chickensoupwithrice in #1159
• Remove username lookups for crawls and workflows by storing usernames in db by @tw4l in #1199
• Passthrough x-forwarded-proto header in frontend nginx by @vnznznz in #1226
• Recalculate Organization.storedBytes in migration 0017 by @tw4l in #1220
• migration improvements: by @ikreymer in #1228
• fix: Right Align Copy Buttons & <btrix-desc-list> vertical width: 100% by @Shrinks99 in #1177
• Disable smtp_use_tls with false instead of empty string by @vnznznz in #1184
• optimization: convert all uses of 'async for' to use iterator directly by @ikreymer in #1229
• improvements to redis pod: by @ikreymer in #1219
• Fix: Stream log downloading from WACZ by @Chickensoupwithrice in #1225
• "Add new" dialog for all resources by @SuaYoo in #1202
• Fix: Make Collections Public on Creation by @Chickensoupwithrice in #1213
• Separate seeds into a new endpoints by @SuaYoo in #1217
• Show storage meter even with no quota by @SuaYoo in #1240
• feat: use is_bool to check EMAIL_SMTP_USE_TLS by @Chickensoupwithrice in #1231
• Show running workflow error logs by @SuaYoo in #1224
• API delete endpoint improvements by @tw4l in #1232
• Update local dev docs by @SuaYoo in #1246
• Add --failOnFailedSeed checkbox to URL list workflows by @tw4l in #1236
• Require that all passwords are between 8 and 64 characters by @tw4l in #1239
• Browser Profile Warning & Dialog Style Updates by @Shrinks99 in https...