Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Install size grows from 89M (released) to 535M (master) #41

Closed
mkitti opened this issue Aug 18, 2022 · 3 comments
Closed

Install size grows from 89M (released) to 535M (master) #41

mkitti opened this issue Aug 18, 2022 · 3 comments

Comments

@mkitti
Copy link

mkitti commented Aug 18, 2022

The currently released version of ImplicitGlobalGrid.jl v0.1 currently installs 72 dependencies taking 89 megabytes of space in a clean Julia depot.

$ export JULIA_DEPOT_PATH=`mktemp -d`; julia -e 'using Pkg; Pkg.add("ImplicitGlobalGrid")' && du -hcs $JULIA_DEPOT_PATH/*
...
  72 dependencies successfully precompiled in 74 seconds
20M	/tmp/tmp.VnWvq05cMG/artifacts
36M	/tmp/tmp.VnWvq05cMG/compiled
32K	/tmp/tmp.VnWvq05cMG/environments
16K	/tmp/tmp.VnWvq05cMG/logs
29M	/tmp/tmp.VnWvq05cMG/packages
4.0K	/tmp/tmp.VnWvq05cMG/prefs
5.0M	/tmp/tmp.VnWvq05cMG/registries
24K	/tmp/tmp.VnWvq05cMG/scratchspaces
89M	total

The master branch after #34 expands this footprint to 95 dependencies taking 535 megabytes of space in a clean Julia depot.

$ export JULIA_DEPOT_PATH=`mktemp -d`; julia -e 'using Pkg; Pkg.add(name="ImplicitGlobalGrid", rev="master")' && du -hcs $JULIA_DEPOT_PATH/*
...
  95 dependencies successfully precompiled in 83 seconds (14 already precompiled)
450M	/tmp/tmp.kVz3DOLI0s/artifacts
7.1M	/tmp/tmp.kVz3DOLI0s/clones
41M	/tmp/tmp.kVz3DOLI0s/compiled
40K	/tmp/tmp.kVz3DOLI0s/environments
20K	/tmp/tmp.kVz3DOLI0s/logs
33M	/tmp/tmp.kVz3DOLI0s/packages
4.0K	/tmp/tmp.kVz3DOLI0s/prefs
5.0M	/tmp/tmp.kVz3DOLI0s/registries
32K	/tmp/tmp.kVz3DOLI0s/scratchspaces
535M	total

I found this while exploring omlins/CellArrays.jl#16 (comment), and I also wanted to document this here. My suggestion there was to split the core code into a small subdirectory package with fewer dependencies, then add that as a dependency of the main package.

@luraess
Copy link
Collaborator

luraess commented Aug 18, 2022

The increase in size is mostly due to the fact that #master branch has now AMDGPU.jl as deps to support ROCm MPI. As you reported elsewhere, AMDGPU.jl is a large package as ships many jll.

@omlins
Copy link
Collaborator

omlins commented Aug 19, 2022

Thanks for investigating this. As you found that it the AMDGPU.jl package that makes uses up most of the space (reported on the other issue you mentioned), please open an issue there instead. I am closing this one therefore.

@omlins omlins closed this as completed Aug 19, 2022
@omlins
Copy link
Collaborator

omlins commented Jan 29, 2024

@mkitti : UPDATE: we have removed the explicit GPU dependencies here making use of extensions; see the release notes of the latest release: https://github.com/eth-cscs/ImplicitGlobalGrid.jl/releases/tag/v0.15.0

This solves also the issue you brought up here completely.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants