Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow multithreading compression #45

Open
dmd opened this issue Mar 15, 2021 · 2 comments
Open

Allow multithreading compression #45

dmd opened this issue Mar 15, 2021 · 2 comments

Comments

@dmd
Copy link

dmd commented Mar 15, 2021

Is there any reason not to use pigz? It's an apt-get install away, it's perfectly gzip compatible, and it's multi-core so vastly faster.

@prodrigestivill
Copy link
Owner

Currently only in case of a compressing using pg_dumpall it relays on the actual gzip command line, and this only applies to postgress clusters.

So the project is mainly using the gzip implementation of pg_dump, not sure if they use threads per database.

Beeing this a backup solution it would only relay on well maintained and well tested software.

Also, in case of needing threading compression there are also xz-utils.

I left this open to see what are the demand for this feature, and in what cases (Cluster or Non cluster).

@prodrigestivill prodrigestivill changed the title use pigz Allow multithreading compression Mar 16, 2021
@dmd
Copy link
Author

dmd commented Mar 16, 2021

Oh, you know what - I didn't notice that you're not doing the gzip yourself. I agree that keeping it simple and without undue dependencies is better than whatever benefit this change would provide.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants