Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

reproduce results on Tanks&Temples Auditorium #25

Open
jinmaodaomaye2021 opened this issue Apr 22, 2024 · 0 comments
Open

reproduce results on Tanks&Temples Auditorium #25

jinmaodaomaye2021 opened this issue Apr 22, 2024 · 0 comments

Comments

@jinmaodaomaye2021
Copy link

jinmaodaomaye2021 commented Apr 22, 2024

Hi author,

Thanks for your contribution of using monocular cues to supervise 3D GS. I am trying to reconstruct the Tanks&Temples Auditorium scene with your code and compare with the results from monosdf. Unfortunately, I found the mesh reconstruction from your code is inferior to monosdf. I am not sure if I followed the same setting as your paper.

The first video is from your code and the second video is from monosdf.

I also attached the rendered depth map and the normal map from DN-Splatter. The depth map looks ok and the normal map is not smooth. Any idea why ?

Thanks.

Experiment setting:

  • mono depth supervision with ZoeDepth, aligned with SfM sparse depth

  • surface normal supervision with Omni data

  • command for training

ns-train dn-splatter --max-num-iterations 30000 --pipeline.model.use-depth-loss True --pipeline.model.mono-depth-lambda 0.2 --pipeline.model.use-depth-smooth-loss True --pipeline.model.use-normal-loss True --pipeline.model.normal-supervision mono coolermap --data Auditorium --depth-mode mono --load-normals True --normals-from pretrained --normal-format opengl --load-depths True

  • command for mesh extraction

gs-mesh dn --load-config Auditorium/config.yml --output-dir Auditorium

3dgs.mp4
sdf.mp4

Screenshot from 2024-04-22 14-51-55

Screenshot from 2024-04-22 14-52-26

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant