Impr/bundler recovery 20260306#738
Merged
samcamwilliams merged 6 commits intoimpr/gunfrom Mar 7, 2026
Merged
Conversation
Now the dev_bundler server manages the dispatch workers directly
Continues the refactoring of the dev_bundler modules and implements functionality to allow unbundled items and unfinished bundles to be recovered incrementally rather than requiring that all data be loaded first before any of it is processed
also force an lmdb flush to disk to ensure recovered items are correctly persisted
samcamwilliams
force-pushed
the
impr/bundler-recovery-20260306
branch
from
a0b2aa0 to
6e8130b
Compare
…ed regression within this PR) Now we do 2 converts before posting a TX: - one to build a Header-only TX that we use for posting. This makes the posting process much quicker - one to biuld a full-data TX tha we use for caching and recovery We shouldn't need to cache the full-data TX, so a future optmization can address that. We'll just have to be careful about rebuilding the data payload from the cache data items to ensure the reult is the same as when the original TX was posted
This breaks the HB loose coupling but for large bundles the TX posts in seconds instead of minutes
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.