Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The evaluation and training code #1

Open
RunqiWang77 opened this issue Jun 26, 2024 · 8 comments
Open

The evaluation and training code #1

RunqiWang77 opened this issue Jun 26, 2024 · 8 comments
Assignees
Labels
bug Something isn't working

Comments

@RunqiWang77
Copy link

The evaluation and training code you published seems to have some issues. They both rely on the same file named 'infer', and I'm unable to successfully run the evaluation and training code. Could you please take a look at it?

@pabloruizponce pabloruizponce added the bug Something isn't working label Jun 26, 2024
@pabloruizponce pabloruizponce self-assigned this Jun 26, 2024
@pabloruizponce
Copy link
Owner

Could you provide more details about the issue for reproducing your error? What is the command that you have executed and what is the output?

@RunqiWang77
Copy link
Author

RunqiWang77 commented Jun 26, 2024

image
The error message is roughly like this. I'm not sure if I misunderstood something. For evaluation, following the instructions on the GitHub page, I executed the command:
python in2in/scripts/infer.py
--model configs/models/in2IN.yaml
--evaluator configs/eval.yaml
--mode [individual, interaction, dual]
--out results
--device 0
--mode interaction \

@pabloruizponce
Copy link
Owner

Ey, there was a typo on the commands in the README 😓. They are now updated:

  python in2in/scripts/eval/interhuman.py \
      --model configs/models/in2IN.yaml \
      --evaluator configs/eval.yaml \
      --mode [individual, interaction, dual] \
      --out results \
      --device 0 \
      --mode  interaction \
  python in2in/scripts/eval/DualMDM.py \
      --model configs/models/DualMDM.yaml \
      --evaluator configs/eval.yaml \
      --device 0 \

Test it and let me know if everything is working as expected.

@RunqiWang77
Copy link
Author

Ey, there was a typo on the commands in the README 😓. They are now updated:

  python in2in/scripts/eval/interhuman.py \
      --model configs/models/in2IN.yaml \
      --evaluator configs/eval.yaml \
      --mode [individual, interaction, dual] \
      --out results \
      --device 0 \
      --mode  interaction \
  python in2in/scripts/eval/DualMDM.py \
      --model configs/models/DualMDM.yaml \
      --evaluator configs/eval.yaml \
      --device 0 \

Test it and let me know if everything is working as expected.

Okay, I will continue to try.

@RunqiWang77
Copy link
Author

RunqiWang77 commented Jul 2, 2024

172552f4821127d290cc2a61eba1d4f
I encountered an error when executing the following command:
python in2in/scripts/eval/DualMDM.py --model configs/models/DualMDM.yaml --evaluator configs/eval.yaml --device 0
The error message says: "No such file or directory: './data/HumanML3D/mean_interhuman.npy'". How can I obtain the mean_interhuman.npy file? Is this file the same as the global_mean.npy file from the dataset link?

@RunqiWang77
Copy link
Author

image
When I execute the following command:
python in2in/scripts/eval/interhuman.py --model configs/models/in2IN.yaml --evaluator configs/eval.yaml --mode [individual, interaction, dual] --out results --device 0 --mode interaction
there are still some issues. Is there something I'm misunderstanding? Thank you.

@pabloruizponce
Copy link
Owner

172552f4821127d290cc2a61eba1d4f I encountered an error when executing the following command: python in2in/scripts/eval/DualMDM.py --model configs/models/DualMDM.yaml --evaluator configs/eval.yaml --device 0 The error message says: "No such file or directory: './data/HumanML3D/mean_interhuman.npy'". How can I obtain the mean_interhuman.npy file? Is this file the same as the global_mean.npy file from the dataset link?

The mean and std for all the normalizers have been updated in the commit 96c38cb. They can be found in the in2in/utils/ folder without downloading any additional file.

@pabloruizponce
Copy link
Owner

image The error message is roughly like this. I'm not sure if I misunderstood something. For evaluation, following the instructions on the GitHub page, I executed the command: python in2in/scripts/infer.py --model configs/models/in2IN.yaml --evaluator configs/eval.yaml --mode [individual, interaction, dual] --out results --device 0 --mode interaction \

In the mode argument, you must select one of the possible modes (interaction or dual). If you want to evaluate in2IN on the InterHuman dataset you will execute:

  python in2in/scripts/eval/interhuman.py \
      --model configs/models/in2IN.yaml \
      --evaluator configs/eval.yaml \
      --mode interaction \
      --out results \
      --device 0 \

On the other hand, If you want to evaluate DualMDM on the InterHuman dataset you will execute:

  python in2in/scripts/eval/interhuman.py \
      --model configs/models/DualMDM.yaml \
      --evaluator configs/eval.yaml \
      --mode dual \
      --out results \
      --device 0 \

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants