ImagenHub
ImagenHub is a comprehensive Python library designed to standardize the inference and evaluation of conditional image generation models. Recognized at ICLR 2024, the platform defines seven prominent generation tasks and provides curated high-quality evaluation datasets for each. It features a unified inference pipeline supporting over fifty models, enabling fair comparisons across different architectures. The library introduces two specialized human evaluation metrics: Semantic Consistency and Perceptual Quality, accompanied by detailed guidelines to assess generated image quality objectively. ImagenHub includes built-in tools for image visualization, automated metrics, and templates for crowd-sourced human evaluation via Amazon Mechanical Turk. The project is available on PyPI and GitHub, with extensive documentation and a public website showcasing results through ImagenMuseum. It also powers GenAI-Arena, a benchmarking platform for visual generative models. ImagenHub serves researchers and developers by str