Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Killed when the data maybe too big #134

Open
KnightSnape opened this issue Sep 27, 2024 · 5 comments
Open

Killed when the data maybe too big #134

KnightSnape opened this issue Sep 27, 2024 · 5 comments

Comments

@KnightSnape
Copy link

I don't know if I've tested it, I used a large-scale data (colmap), put it into OpenSplat, nerfstudio's nerfacto and 3d_gaussian_splatting respectively, and only OpenSplat was killed when importing, nerfstudio trained normally, which factor formed such a difference? Will a fix be attempted in the future?

@pierotofy
Copy link
Owner

pierotofy commented Sep 27, 2024

We'd welcome a pull request that fixes/optimizes any memory issue that might be present in OpenSplat. 🙏

@mureva
Copy link

mureva commented Oct 4, 2024

I don't know if relates to your problem, but I was trying to use a lidar point cloud as the initial point cloud for splatting, and would get a runtime errror. A bit of sleuthing suggested that the issue was nanoflann, an it appeared to be getting to the recursion limit of the system. An older version of nanoflann (1.3.0) was able to deal with my point cloud without problem - but meant a small amount of modification to opensplat to use.

@liamyehudai
Copy link

We are also having this issue

@psykon
Copy link

psykon commented Oct 19, 2024

Same issue here. I have a colmap dataset with 3564 images. OpenSplat seems to attempt to load all images into memory at once. After committing ~160Gb to memory, the process shuts down with a cv::OutOfMemoryError message.
This happens with the prebuilt windows binary.

Switching to CPU instead of cuda does not make any difference, neither does setting a downscale factor make a difference in this behavior.

Is this a expected limitation of OpenSplat or a unexpected error?

@pierotofy
Copy link
Owner

pierotofy commented Oct 19, 2024

You need more RAM, currently. We'd welcome a PR that improves memory management.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants