Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

poor texture for my model #24

Open
miaowu99 opened this issue Aug 13, 2024 · 5 comments
Open

poor texture for my model #24

miaowu99 opened this issue Aug 13, 2024 · 5 comments

Comments

@miaowu99
Copy link

I followed the process in readme to run the program and wanted to texture my car model, but the result did not meet my expectations. May I ask where I ran it incorrectly?
prompt: change "monkey head" to "red car"
result:
2024-08-13 11-39-45 的屏幕截图

result of stage1/init-img-0.png:
init-img-0

axis is Zup

@miaowu99
Copy link
Author

I found that the generated texture has a vertical flipping relationship with my original texture. Although I don't know why, after correcting this, the result is slightly normal, but still not good.
the stage1/init-img-0.png is good, but I only have front and rear views, no left and right views, right?
init-img-0
After stage2, the texture result looks terrible in a specific area, no matter how I rotate the mesh.
UV_inpaint_res_0
And I also found an UV_pos.png, how to use this?

@miaowu99
Copy link
Author

before stage2:
albedo
after stage2:
UV_inpaint_res_0
result:
https://github.com/user-attachments/assets/a4a424bd-5454-4a7c-96f9-6cef43407ef9

@miaowu99
Copy link
Author

miaowu99 commented Aug 14, 2024

After some modifications, my results look better than before:
2024-08-14 11-48-01 的屏幕截图

  1. Make sure the model is Yup and Zfront
  2. Delete the original texture information in the model.
  3. Set pipeline_paint3d_stage2.py line53, "export_texture_only" False, to export mesh, instead of using the original mesh to load the texture.
  4. Delete paint3d_cache/* when changed the model of the same name.

Of course, there are still some issues that have not been resolved:

  1. Visible textured seams.
  2. Multi-faces problem.
  3. Blurred and inconsistent in some areas.

Are these issues inherent to the methods themselves? Is there a plan to optimize these issues in the future, or are there any better similar methods recommend?
Thanks for the excellent work.

@Zzlongjuanfeng
Copy link
Contributor

After some modifications, my results look better than before: 2024-08-14 11-48-01 的屏幕截图

  1. Make sure the model is Yup and Zfront
  2. Delete the original texture information in the model.
  3. Set pipeline_paint3d_stage2.py line53, "export_texture_only" False, to export mesh, instead of using the original mesh to load the texture.
  4. Delete paint3d_cache/* when changed the model of the same name.

Of course, there are still some issues that have not been resolved:

  1. Visible textured seams.
  2. Multi-faces problem.
  3. Blurred and inconsistent in some areas.

Are these issues inherent to the methods themselves? Is there a plan to optimize these issues in the future, or are there any better similar methods recommend? Thanks for the excellent work.

Yes, we are working on addressing the challenges of multi-face generation and inconsistencies. Thank you for your attention.

@cjkangme
Copy link

cjkangme commented Aug 20, 2024

@miaowu99

In my opinion, if there are many holes in the texture map after stage 1, most of the original texture is masked out due to the large dilate kernel size in stage 2.
So I think this could lead to a terrible-looking texture.

I think adjusting the dilate kernel size when extracting the mask could be one of the possible solutions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants