Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Getting NaNs as the output of recurrent layer #278

Open
KimiaMohsenian opened this issue Aug 11, 2024 · 0 comments
Open

Getting NaNs as the output of recurrent layer #278

KimiaMohsenian opened this issue Aug 11, 2024 · 0 comments

Comments

@KimiaMohsenian
Copy link

KimiaMohsenian commented Aug 11, 2024

Hello,

I have created a costume dataset using Dynamic Graph Temporal Signal class, where I have varying edge indices and edge weights among snapshots.
My goal is to perform a binary classification on nodes. I constructed different models where I tried out different PGT layers, like GConvGRU, GConvLSTM and TGCN. My problem is that these layers give me outputs with all elements being NaNs.

Please note that my edge weights are positive values (ranging from 1 to some millions). I also tried log transformation of edge weights so there won't be too large values, but am still getting NaNs at the very first forward pass. I also tried setting the edge weights to be None, or some random tensors, but still get NaNs as outputs.

Below I provided one of my model architectures. the first layer (recurrent) is the one outputing NaNs.
model

I would really appreciate any comments or helps on this issue!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant