ReVersion
ReVersion is a diffusion-based framework for a new computer vision task called Relation Inversion. Presented at SIGGRAPH Asia 2024 by researchers from MMLab at Nanyang Technological University, ReVersion allows users to discover and capture specific interactions or relations between entities from a few exemplar images. Given input images containing a consistent relationship, the system generates a compact relation prompt that encodes this interaction. Once learned, this prompt can be applied to entirely new entities to synthesize novel scenes where the extracted relationship is preserved. The software enables creative image generation by extending learned concepts like specific poses, collaborations, or physical interactions across different subjects. ReVersion features an optimized implementation where only the lightweight relation prompt needs to be saved and loaded, eliminating the need to store the full text-to-image model. The project includes a released benchmark dataset, pre-trained relation prompts, t