VBench
VBench is a comprehensive benchmark suite for evaluating video generative models, recognized as a CVPR 2024 Highlight. It provides unified implementations to assess video generation capabilities across a wide spectrum of dimensions, including subject consistency, background consistency, temporal flickering, motion smoothness, aesthetic quality, imaging quality, object class adherence, color harmony, and prompt alignment. The framework leverages human-aligned evaluation methods to ensure results correlate closely with human preferences. VBench supports various video generation models and offers tools for prompt suites, sampled video analysis, and detailed metric computation. The suite includes updated versions such as VBench++ and VBench 2.0 to address evolving evaluation needs and expand covered capabilities. Researchers and developers utilize VBench to compare model performance, identify weaknesses, and guide improvements in video synthesis technology. The project offers leaderboard results on Hugging Face,