Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create a new benchmarking run comparing also with as downloaded (e.g. to drogon, same spindles) #89

Open
yarikoptic opened this issue Aug 15, 2024 · 4 comments
Assignees

Comments

@yarikoptic
Copy link
Member

Continuation to

Would be great to see a comparison on a sample nwb file between

I would like to see benchmarking results on a sample nwb for matnwb test

  • directly as downloaded
  • datalad-fuse downloaded
  • datalad-fuse online
  • (ideally) datalad-fuse with caching cold
  • (ideally) datalad-fuse with caching hot
  • davfs
@jwodder
Copy link
Member

jwodder commented Aug 15, 2024

@yarikoptic

  • (ideally) datalad-fuse with caching cold
  • (ideally) datalad-fuse with caching hot

How am I supposed to achieve these? Are you referring to datalad-fuse's built-in caching or regular disk caching?

@jwodder
Copy link
Member

jwodder commented Aug 22, 2024

@yarikoptic Ping.

@yarikoptic
Copy link
Member Author

datalad's fsspec level (so built in I guess) caching. Just to first access without cache, and then access after having already accessed once (so accessed data is cached and present locally)

@yarikoptic
Copy link
Member Author

Please also include in the result stat how much of data was fetched -- for fsspec-based cache size, and for davfs sizes of its cache before/after (I think it downloads full file).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants