You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Thanks for creating VBench, this is a very nice eval benchmark suite.
I find it useful to evaluate a custom prompt_list and corresponding videos. When running vbench2_beta_i2v with custom prompt_list, the prompts does not look to be correctly propagated to the eval. I think that is related to the missing of **kwargs in build_full_info_json: