Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enterprise blobber #1456

Draft
wants to merge 82 commits into
base: sprint-1.17
Choose a base branch
from
Draft

Enterprise blobber #1456

wants to merge 82 commits into from

Commits on Jun 27, 2024

  1. remove vt mt wm and challenge workers

    @Hitenjain14
    Hitenjain14 committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    573c473 View commit details
    Browse the repository at this point in the history

Commits on Jun 29, 2024

  1. Merge branch 'feat/ref-index' of https://github.com/0chain/blobber in… 

    …to feat/enterprise-blobber
    @Hitenjain14
    Hitenjain14 committed Jun 29, 2024
    Configuration menu
    Copy the full SHA
    b28ba79 View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. change apply changes

    @Hitenjain14
    Hitenjain14 committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    4178fc3 View commit details
    Browse the repository at this point in the history

  2. support upload,delete and createdir for enterprise

    @Hitenjain14
    Hitenjain14 committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    995912d View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2024

  1. remove unused columns in ref table

    @Hitenjain14
    Hitenjain14 committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    b34a7e8 View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2024

  1. remove hash field from ref

    @Hitenjain14
    Hitenjain14 committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    d273658 View commit details
    Browse the repository at this point in the history

  2. parent id

    @Hitenjain14
    Hitenjain14 committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    85ec94f View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2024

  1. mkdir and version marker

    @Hitenjain14
    Hitenjain14 committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    a04e758 View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2024

  1. add version markers table

    @Hitenjain14
    Hitenjain14 committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    e012e66 View commit details
    Browse the repository at this point in the history

Commits on Jul 21, 2024

  1. add repair in version marker

    @Hitenjain14
    Hitenjain14 committed Jul 21, 2024
    Configuration menu
    Copy the full SHA
    23e7eb9 View commit details
    Browse the repository at this point in the history

  2. add prev size and add vm to rollback

    @Hitenjain14
    Hitenjain14 committed Jul 21, 2024
    Configuration menu
    Copy the full SHA
    7e3540d View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2024

  1. fix sql migration and use pointer for parent id

    @Hitenjain14
    Hitenjain14 committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    7454b0b View commit details
    Browse the repository at this point in the history

  2. fix ref table

    @Hitenjain14
    Hitenjain14 committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    c0cfba3 View commit details
    Browse the repository at this point in the history

  3. fix allocation table

    @Hitenjain14
    Hitenjain14 committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    854fac7 View commit details
    Browse the repository at this point in the history

  4. add info log

    @Hitenjain14
    Hitenjain14 committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    8ff1e38 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/sprint-1.17' into feat/enterpris… 

    …e-blobber
    @Hitenjain14
    Hitenjain14 committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    58cee84 View commit details
    Browse the repository at this point in the history

  6. fix upload validation

    @Hitenjain14
    Hitenjain14 committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    de07b61 View commit details
    Browse the repository at this point in the history

  7. remove fileMeta

    @Hitenjain14
    Hitenjain14 committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    75c745c View commit details
    Browse the repository at this point in the history

  8. init hasher

    @Hitenjain14
    Hitenjain14 committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    f8de5a9 View commit details
    Browse the repository at this point in the history

  9. add log for file path

    @Hitenjain14
    Hitenjain14 committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    868c861 View commit details
    Browse the repository at this point in the history

  10. add check for root path

    @Hitenjain14
    Hitenjain14 committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    1c129ec View commit details
    Browse the repository at this point in the history

  11. add ts

    @Hitenjain14
    Hitenjain14 committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    1a2edaa View commit details
    Browse the repository at this point in the history

  12. add check for root ref

    @Hitenjain14
    Hitenjain14 committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    4c0a6ab View commit details
    Browse the repository at this point in the history

  13. fix version marker id

    @Hitenjain14
    Hitenjain14 committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    ce2543b View commit details
    Browse the repository at this point in the history

  14. add file meta hash for dir

    @Hitenjain14
    Hitenjain14 committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    0a6fe41 View commit details
    Browse the repository at this point in the history

  15. fix allocation update in commit

    @Hitenjain14
    Hitenjain14 committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    67f5ee6 View commit details
    Browse the repository at this point in the history

  16. fix file path hash in commit write

    @Hitenjain14
    Hitenjain14 committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    2e13ad9 View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2024

  1. get hasher in base changer

    @Hitenjain14
    Hitenjain14 committed Jul 23, 2024
    Configuration menu
    Copy the full SHA
    22017d3 View commit details
    Browse the repository at this point in the history

  2. check for created refs

    @Hitenjain14
    Hitenjain14 committed Jul 23, 2024
    Configuration menu
    Copy the full SHA
    3a4c4df View commit details
    Browse the repository at this point in the history

  3. add check for dir in delete

    @Hitenjain14
    Hitenjain14 committed Jul 23, 2024
    Configuration menu
    Copy the full SHA
    dd6f54e View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2024

  1. fix get refs and add is empty and alloc version to ref

    @Hitenjain14
    Hitenjain14 committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    a7d405f View commit details
    Browse the repository at this point in the history

  2. fix build

    @Hitenjain14
    Hitenjain14 committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    0321e66 View commit details
    Browse the repository at this point in the history

  3. fix seq cache and add logs

    @Hitenjain14
    Hitenjain14 committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    b1985d1 View commit details
    Browse the repository at this point in the history

  4. use or

    @Hitenjain14
    Hitenjain14 committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    7d35775 View commit details
    Browse the repository at this point in the history

  5. add check for 0 id

    @Hitenjain14
    Hitenjain14 committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    bc2cadc View commit details
    Browse the repository at this point in the history

  6. fix parent ref id

    @Hitenjain14
    Hitenjain14 committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    991a7ed View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2024

  1. fix get parent paths

    @Hitenjain14
    Hitenjain14 committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    58e4317 View commit details
    Browse the repository at this point in the history

  2. fix dir list fields

    @Hitenjain14
    Hitenjain14 committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    7719bd7 View commit details
    Browse the repository at this point in the history

  3. fix dirlist tag for allocation version

    @Hitenjain14
    Hitenjain14 committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    c62ddaa View commit details
    Browse the repository at this point in the history

  4. add check for parent path of root

    @Hitenjain14
    Hitenjain14 committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    79c0bf2 View commit details
    Browse the repository at this point in the history

  5. add id to select for dir

    @Hitenjain14
    Hitenjain14 committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    12b4e25 View commit details
    Browse the repository at this point in the history

  6. set model

    @Hitenjain14
    Hitenjain14 committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    1bce447 View commit details
    Browse the repository at this point in the history

  7. fix num block column

    @Hitenjain14
    Hitenjain14 committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    50f6f1c View commit details
    Browse the repository at this point in the history

  8. add check for return directory

    @Hitenjain14
    Hitenjain14 committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    5a0559c View commit details
    Browse the repository at this point in the history

  9. add a check for level in get refs

    @Hitenjain14
    Hitenjain14 committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    20cfb0f View commit details
    Browse the repository at this point in the history

  10. order by level and path

    @Hitenjain14
    Hitenjain14 committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    de124d0 View commit details
    Browse the repository at this point in the history

  11. rever order by level

    @Hitenjain14
    Hitenjain14 committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    c367f4e View commit details
    Browse the repository at this point in the history

  12. fix query

    @Hitenjain14
    Hitenjain14 committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    2f90507 View commit details
    Browse the repository at this point in the history

  13. remove unused fields in select

    @Hitenjain14
    Hitenjain14 committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    e1163d3 View commit details
    Browse the repository at this point in the history

  14. add check for empty dir in apply change

    @Hitenjain14
    Hitenjain14 committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    8b6646f View commit details
    Browse the repository at this point in the history

  15. fix build and add check for update allocation

    @Hitenjain14
    Hitenjain14 committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    a2e49b9 View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2024

  1. add move,copy and rename

    @Hitenjain14
    Hitenjain14 committed Jul 27, 2024
    Configuration menu
    Copy the full SHA
    1bb9f00 View commit details
    Browse the repository at this point in the history

  2. add logs

    @Hitenjain14
    Hitenjain14 committed Jul 27, 2024
    Configuration menu
    Copy the full SHA
    36fa635 View commit details
    Browse the repository at this point in the history

  3. set name

    @Hitenjain14
    Hitenjain14 committed Jul 27, 2024
    Configuration menu
    Copy the full SHA
    84f875a View commit details
    Browse the repository at this point in the history

  4. add deleted at

    @Hitenjain14
    Hitenjain14 committed Jul 27, 2024
    Configuration menu
    Copy the full SHA
    c92a62a View commit details
    Browse the repository at this point in the history

  5. add collector cache

    @Hitenjain14
    Hitenjain14 committed Jul 27, 2024
    Configuration menu
    Copy the full SHA
    4bcd3a4 View commit details
    Browse the repository at this point in the history

  6. fix index

    @Hitenjain14
    Hitenjain14 committed Jul 27, 2024
    Configuration menu
    Copy the full SHA
    a604d5d View commit details
    Browse the repository at this point in the history

  7. init map

    @Hitenjain14
    Hitenjain14 committed Jul 27, 2024
    Configuration menu
    Copy the full SHA
    0606901 View commit details
    Browse the repository at this point in the history

  8. add new indexes

    @Hitenjain14
    Hitenjain14 committed Jul 27, 2024
    Configuration menu
    Copy the full SHA
    adb7fac View commit details
    Browse the repository at this point in the history

  9. update is_precommit index

    @Hitenjain14
    Hitenjain14 committed Jul 27, 2024
    Configuration menu
    Copy the full SHA
    60cf8c8 View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2024

  1. use materialized path

    @Hitenjain14
    Hitenjain14 committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    8b91732 View commit details
    Browse the repository at this point in the history

  2. hardcode limit values

    @Hitenjain14
    Hitenjain14 committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    67bb51b View commit details
    Browse the repository at this point in the history

  3. remove parent path index

    @Hitenjain14
    Hitenjain14 committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    26733c6 View commit details
    Browse the repository at this point in the history

  4. fix type

    @Hitenjain14
    Hitenjain14 committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    5050629 View commit details
    Browse the repository at this point in the history

  5. remove ref type

    @Hitenjain14
    Hitenjain14 committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    66d466f View commit details
    Browse the repository at this point in the history

  6. revert index changes

    @Hitenjain14
    Hitenjain14 committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    071b9c5 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'feat/enterprise-blobber' of https://github.com/0chain/b… 

    …lobber into feat/enterprise-blobber
    @Hitenjain14
    Hitenjain14 committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    ae7a84f View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2024

  1. Use alloc version in place of precommit (#1465) 

    * use alloc version in place of precommit

* add timing log for finalize

* add upload changer timing logs

* use multiple txns

* add txn in mkdir

* remove lock in upload changer

* fix dest ref in mkdir

* add gorm logger

* go mod tidy

* add logger config for gorm

* use ptr for create

* change constraint name

* fix lookup hash constraint

* remove index from drop

* add created ref to cache

* use hash for lookup

* add cache logs

* fix change index

* remove deleted at clause

* add check for file ref

* add option for empty commit

* fix create marker in rollback handler

* add thumbnail suffix in write file

* add fix for move and copy

* add log

* use refLookupHash

* set num blocks

* add fix for destpath

* add max connection changes in config

* rmv get wm in file stats

* increment num_of_updates
    @Hitenjain14
    Hitenjain14 authored Aug 9, 2024
    Configuration menu
    Copy the full SHA
    5330ba8 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin' into feat/enterprise-blobber

    @Hitenjain14
    Hitenjain14 committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    f49dd1b View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2024

  1. add size for root dir

    @Hitenjain14
    Hitenjain14 committed Aug 10, 2024
    Configuration menu
    Copy the full SHA
    5a25266 View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2024

  1. Merge remote-tracking branch 'origin/sprint-1.17' into feat/enterpris… 

    …e-blobber
    @Hitenjain14
    Hitenjain14 committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    bd9ccdb View commit details
    Browse the repository at this point in the history

Commits on Aug 18, 2024

  1. rmv hash len check in get path for file

    @Hitenjain14
    Hitenjain14 committed Aug 18, 2024
    Configuration menu
    Copy the full SHA
    d748809 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2024

  1. add slash seperator

    @Hitenjain14
    Hitenjain14 committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    dd6787f View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. fix list root

    @Hitenjain14
    Hitenjain14 committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    350bb7e View commit details
    Browse the repository at this point in the history

  2. add log for connection obj

    @Hitenjain14
    Hitenjain14 committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    f8aefee View commit details
    Browse the repository at this point in the history

  3. Merge branch 'feat/enterprise-blobber' of https://github.com/0chain/b… 

    …lobber into feat/enterprise-blobber
    @Hitenjain14
    Hitenjain14 committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    0cbbfe2 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. add log for blacklist

    @Hitenjain14
    Hitenjain14 committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    ffb861c View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2024

  1. add get refs log

    @Hitenjain14
    Hitenjain14 committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    dfd6a26 View commit details
    Browse the repository at this point in the history

  2. add return

    @Hitenjain14
    Hitenjain14 committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    991b638 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2024

  1. fix concurrent read and write

    @Hitenjain14
    Hitenjain14 committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    37296f3 View commit details
    Browse the repository at this point in the history

  2. add unlock

    @Hitenjain14
    Hitenjain14 committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    421e1a4 View commit details
    Browse the repository at this point in the history

Commits on Nov 11, 2024

  1. fix duplicate dir (#1504) 

    * fix duplicate dir

* fix duplicate check
    @Hitenjain14
    Hitenjain14 authored Nov 11, 2024
    Configuration menu
    Copy the full SHA
    66ca94e View commit details
    Browse the repository at this point in the history