Skip to content

vbench2_beta_i2v is not handling custom prompt_list #173

@wanwanbeen

Description

@wanwanbeen

Hi authors,

Thanks for creating VBench, this is a very nice eval benchmark suite.

I find it useful to evaluate a custom prompt_list and corresponding videos. When running vbench2_beta_i2v with custom prompt_list, the prompts does not look to be correctly propagated to the eval. I think that is related to the missing of **kwargs in build_full_info_json:

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions