Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fail to reproduce (Co3D dataset). Ques: Image resolution + Pretrained model #7

Open
WalterC9 opened this issue Jun 27, 2024 · 1 comment

Comments

@WalterC9
Copy link

Hi, thank you very much for sharing your code. I have several questions regarding your work:

  1. Could you specify the image resolution used during training for each scene in the Co3D dataset?

  2. Would it be possible for you to share your pretrained Gaussians from the Co3D dataset? This would be very helpful for comparing qualitative results between different methods.

  3. I encountered an out-of-memory issue while trying to reproduce the results on the Co3D dataset (though it works fine for the Tanks dataset). Your paper mentions that a single RTX 3090 is sufficient to train the model, so I expected the code to work on my RTX 4090. Did you face this issue during your training? If so, how did you resolve it?

Your help is greatly appreciated!

@OasisYang
Copy link
Collaborator

  1. In most cases, we used the original resolution for scenes in the CO3D dataset.
  2. Sure, I'm trying to find the rendered RGB images used in our paper and will upload them as soon as possible. To reproduce the results shown in our paper, please use the ZoeDepth as the depth estimator
  3. I didn't face this problem for experiments on CO3D and Tanks&Temples, but I got this issue when running on some internet videos. This may caused by the inaccurate pose estimation as we didn't optimize the pose along with the optimization of the global gaussian model. Our follow-up work resolves this issue by a joint optimization on camera poses and 3D gaussian. Feel free to play with it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants