Skip to content

About the evaluation metrics and evaluation protocol. #7

Description

@AndrewChiyz

Hi, Thank you for sharing the DwNet code.

I have a few questions about the evaluation protocol in your paper. Would you please provide me with more details on the evaluation process on the test set of Fashion Dataset? and how to get the quantitative results in Table 1?

To me, a reasonable evaluation process may be, for example, there are 100 videos in the test set of the Fashion dataset. For cross-video motion transfer, we can choose the first frame of one video as the source frame, and another video from the rest 99 videos as the driving video, then 99 videos will be generated. Therefore, there will be 9,900 synthesized videos in total. For self-imitation or intra-video synthesis, 100 videos will be generated by setting the driving video as the same one. Then we can calculate the evaluation metrics on these 10,000 videos. Is this a reasonable evaluation process? or Could you please clarify the evaluation protocol in your paper? For the evaluation metric, is it calculated on each generated video or on all the generated frames?

Thank you!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions