Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performance and efficiency of data storage #77

Open
smarr opened this issue Mar 10, 2022 · 3 comments
Open

Performance and efficiency of data storage #77

smarr opened this issue Mar 10, 2022 · 3 comments

Comments

@smarr
Copy link
Owner

smarr commented Mar 10, 2022

The current form of storing all measurements in a table does not seem to work very well in practice.

It seems to take a lot of storage, and it seems to be slow to retrieve the data.

We may want to change how measurements are stored.

Initial ideas for possible options:

@smarr
Copy link
Owner Author

smarr commented May 20, 2022

For the different options, one thing to keep in mind:

https://twitter.com/Envek/status/1526922431780233218?t=l09q22EVlOSKsw41QHAXmA&s=19

Though, we don't need to worry about the cost of updates, since data is immutable.

@smarr
Copy link
Owner Author

smarr commented Aug 3, 2022

First work is done in #100.

@smarr
Copy link
Owner Author

smarr commented Aug 6, 2022

First set of benchmarks is implemented with #115.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant