Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding lzfse compression #186

Open
jakirkham opened this issue Feb 14, 2017 · 4 comments
Open

Adding lzfse compression #186

jakirkham opened this issue Feb 14, 2017 · 4 comments

Comments

@jakirkham
Copy link
Contributor

Seeing as zstd is present. Thought it would be worth adding lzfse as well. It belongs to the same class of compression algorithms (FSE).

ref: https://github.com/lzfse/lzfse

@FrancescAlted
Copy link
Member

Yes, many codecs can be included in Blosc, but in order to avoid overlapping, I'd like to see which advantages would bring this over the existing codecs (seeing actual figures would be nice). Same applies to #187 .

@jakirkham
Copy link
Contributor Author

This actually seems to be a pretty nice collection of data points on various compression algorithms on standard datasets.

ref: https://quixdb.github.io/squash-benchmark/

@FrancescAlted
Copy link
Member

FrancescAlted commented Feb 23, 2017 via email

@jakirkham
Copy link
Contributor Author

Well, they have some things in there like X-Ray data, an MRI, etc. That said, I think we need to refine our question more if we want to find a more specific answer. Examples would be helpful too. Though it should be noted that doing a good comparison (especially of Blosc specific features) will also require some level of integration to make it feasible.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants