Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

关于models/fusion.py #32

Open
GolfHotelSierra opened this issue Dec 8, 2024 · 0 comments
Open

关于models/fusion.py #32

GolfHotelSierra opened this issue Dec 8, 2024 · 0 comments

Comments

@GolfHotelSierra
Copy link

感谢您的工作，对于Style-content Fusion Module的实现我有一些疑问希望可以得到您的解答

按照论文中的描述，看起来低频特征和高频特征会在组合后一起进行计算，
image

但是在 models/fusion.py 的 generate() 方法中，看起来低频特征和高频特征是分开进行计算的，

style_hs = self.decoder(content, anchor_low_feature, tgt_mask=None)
hs = self.fre_decoder(style_hs[0], anchor_high_feature, tgt_mask=None)

请问低频特征和高频特征的组合是在代码中的什么部分实现的？以及这两次decode分别对应的是什么操作？

感谢您的解答
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@GolfHotelSierra