Code

Zstd experiment#4

Code

Open

ericvolp12 wants to merge 8 commits intoericvolp12:mainericvolp12/jetstream:mainfrom bluesky-social:zstd_experimentbluesky-social/jetstream:zstd_experimentCopy head branch name to clipboard

+348-170

Commits

Commits on Sep 19, 2024

• Migrate package paths to bluesky-social

  ericvolp12

  committed
  be2fbfb

  Copy full SHA for be2fbfb

Commits on Sep 20, 2024

• Allow for NSID prefix specification and put reasonable limits on it

  ericvolp12

  committed
  d118127

  Copy full SHA for d118127

Commits on Sep 21, 2024

• Be more accepting of prefixes

  ericvolp12

  committed
  4a0a0e2

  Copy full SHA for 4a0a0e2

Commits on Sep 22, 2024

• Experiment with ZSTD compression for Jetstream

  ericvolp12

  committed
  1cf0d42

  Copy full SHA for 1cf0d42

• ZSTD training script and resulting dictionary

  ericvolp12

  committed
  a41ccb1

  Copy full SHA for a41ccb1

• Gitignore bump

  ericvolp12

  committed
  d2b963e

  Copy full SHA for d2b963e

• Store both compressed and uncompressed playback buffers, only compress events once, never decompress on the server

  ericvolp12

  committed
  28c1ba2

  Copy full SHA for 28c1ba2

• Embed zstd dictionary and update readme

  ericvolp12

  committed
  4b41676

  Copy full SHA for 4b41676