-
Notifications
You must be signed in to change notification settings - Fork 208
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
CuTorch out of memory issue, how to allow system ram usage #730
Comments
One approach that I did (and worked) is install LUA5.2 instead of LUAJIT. |
Hello, thanks for the answer /home/michael/distro/install/bin/lua: /home/michael/distro/install/share/lua/5.2/trepl/init.lua:389: /home/michael/distro/install/share/lua/5.2/hdf5/ffi.lua:56: expected align(#) on line 579 It seems others have ran into this bug : google-deepmind/torch-hdf5#79 |
Hello again THCudaCheck FAIL file=/home/michael/distro/extra/cutorch/lib/THC/generic/THCStorage.cu line=66 error=2 : out of memory Notice it ran the luajit binary, it shouldn't should it ? I had cleaned then installed torch again with TORCH_LUA_VERSION=52 though ... |
I think you should remove the whole torch folder before re-installing it again. Did you install Lua somewhere else as well? |
I removed the whole torch folder and tried typing "lua" in a terminal, I found another binary in usr/bin by typing "which lua" and deleted it /home/michael/distro/install/bin/lua: /home/michael/distro/install/share/lua/5.2/trepl/init.lua:389: /home/michael/.luarocks/share/lua/5.1/hdf5/ffi.lua:56: expected align(#) on line 579 I think when I thought I was rid of it I was simply running luajit ... Don't know how to get past this issue, any ideas ? |
I think I actually solved the problem this time by going back to gcc 4.8 (was on gcc 5.4) and running the installation all over again with TORCH_LUA_VERSION=LUA52 THCudaCheck FAIL file=/home/michael/distro/extra/cutorch/lib/THC/generic/THCStorage.cu line=66 error=2 : out of memory This time it seems the lua binary is correctly used instead of luajit |
I didn't do image synthesis. I just merged CNN (VGG 16)-LSTM into one model (2-hidden layers, hidden size is 500), and it takes around 3GB. |
Ok so I suppose you have less than 3GB of gpu memory so that your computer had to use ram, but were you having the same error ? (same as the last one I showed) |
No, I use GTX-1080. Most of my recent errors has something to do with the BIOS because when I reset everything to default, it's working normally now. |
I just looked up the GTX-1080 it's got at least 8GB so you probably weren't running out of memory (not because you didn't have enough of it anyway) |
Hello, I'm trying to run style transfer as implemented in this repository https://github.com/leongatys/NeuralImageSynthesis on my gpu using cuTorch but i can't go beyond a 500x500 image size with my 2GB of gpu memory and running on cpu is way too slow, so i was thinking i could get around this by making the gpu use some system ram which it forbids itself to do.
I know that would be slower but that's still better than nothing.
Does anyone know how i can let the gpu use ram ? I googled a bit and found this https://developer.blender.org/D2056 , but i don't know if it can help and how
Thanks
The text was updated successfully, but these errors were encountered: