Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

services/horizon/ingest: Use buffered storage backend for reingest command #5374

Merged
merged 27 commits into from
Jul 18, 2024
Merged

services/horizon/ingest: Use buffered storage backend for reingest command #5374

merged 27 commits into from
Jul 18, 2024

Commits on Jul 3, 2024

  1. #4911: added new config interface for precomputed ledger backend

    @sreuland
    sreuland committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    ff28599 View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2024

  1. #4911: fixed syntax error on backend type enum

    @sreuland
    sreuland committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    54dfcc3 View commit details
    Browse the repository at this point in the history

  2. #4911: added buffered storage ledger backend to NewSystem factory method

    @sreuland
    sreuland committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    5a020f3 View commit details
    Browse the repository at this point in the history

  3. services/horizon: Reingest from precomputed TxMeta (#5375) 

    * services/horizon: Reingest from precomputed TxMeta

* udpate config

* Fix govet error
    @urvisavla
    urvisavla committed Jul 5, 2024
    1 Configuration menu
    Copy the full SHA
    5d8d64b View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2024

  1. #4911: add unit test coverage on buffered backend ingest system creat… 

    …ion (#5377)
    @sreuland
    sreuland committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    b37be69 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/master' into reingest_precomputed

    @sreuland
    sreuland committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    2053cdf View commit details
    Browse the repository at this point in the history

  3. #4911: fixed lexie integration tests to use datastore factory function

    @sreuland
    sreuland committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    7a267a6 View commit details
    Browse the repository at this point in the history

  4. services/horizon: Skip captive-core configuration when reingesting fr… 

    …om datastore (#5380)

* services/horizon: Reingest from precomputed TxMeta

* Global network config for reingestion

* Remove AlwaysIngest option since Ingest is now true by default
    @urvisavla
    urvisavla committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    a873570 View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2024

  1. #4911: added --parallel-job-size=100 default when datastore backend u… 

    …sed (#5379)
    @sreuland
    sreuland committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    4491049 View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2024

  1. services/horizon: Add unit test for new --ledgerbackend flag (#5382) 

    * services/horizon: Reingest from precomputed TxMeta

* Global network config for reingestion

* Add unit test for new --ledgerbackend flag

* Fix unit test

* Add unittest for network flags validation
    @urvisavla
    urvisavla committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    7234d6e View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2024

  1. #4911: added test for reingest with --ledgerbackend datastore (#5383)

    @sreuland
    sreuland committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    7dc9ffb View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2024

  1. #4911: updated changelog/readme (#5389)

    @sreuland
    sreuland committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    01fbf9c View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/master' into reingest_precomputed

    @sreuland
    sreuland committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    efc8da9 View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2024

  1. 4911: review feedback, remove nil check

    @sreuland
    sreuland committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    96284d0 View commit details
    Browse the repository at this point in the history

  2. #4911: use ledger backend enum names for command help, review feedback

    @sreuland
    sreuland committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    8d543ba View commit details
    Browse the repository at this point in the history

  3. #4911: use fakestoreage initial objects instead of seed path for fake… 

    … bucket files, review feedback
    @sreuland
    sreuland committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    d8110f9 View commit details
    Browse the repository at this point in the history

  4. #4911: fix go mod tidy

    @sreuland
    sreuland committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    bf28af6 View commit details
    Browse the repository at this point in the history

  5. Addressing review comment on --datastore-config parameter validation

    @urvisavla
    urvisavla committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    7f1fe64 View commit details
    Browse the repository at this point in the history

  6. Fix static check errors

    @urvisavla
    urvisavla committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    0f77ac6 View commit details
    Browse the repository at this point in the history

  7. Remove unused parameter from datastore::GetSchema

    @urvisavla
    urvisavla committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    8c1adae View commit details
    Browse the repository at this point in the history

  8. Remove unused context parameter

    @urvisavla
    urvisavla committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    e8261f8 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2024

  1. #4911: removed NewSystem unit test and related factory creation metho… 

    …ds for DataStore, BufferedStorageBackend, review feedback
    @sreuland
    sreuland committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    08f3ab2 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/master' into reingest_precomputed

    @sreuland
    sreuland committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    5793896 View commit details
    Browse the repository at this point in the history

  3. #4911: try refactor integration.NewTest to allow only web process and… 

    … rw db, migrated
    @sreuland
    sreuland committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    026d41e View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2024

  1. #4911: fix integeation test StartHorizon usage when intentional cmd e… 

    …xec error, make sure close db conn regardless during test shutdown
    @sreuland
    sreuland committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    1642a1a View commit details
    Browse the repository at this point in the history

  2. #4911: fixed environment integration test of tests, needed to shutdow… 

    …n test during test
    @sreuland
    sreuland committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    38f2b6d View commit details
    Browse the repository at this point in the history

  3. #4911: revert some of prior change, need to keep the time.sleep on so… 

    …me parameters_test cases due to ingest bug stated in comments
    @sreuland
    sreuland committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    dee1424 View commit details
    Browse the repository at this point in the history