PanoSCU

Full description

The Panoramic Scene Change Understanding (PanoSCU) dataset supports eight research tasks, encompassing both image-level and scene-level panorama settings. These tasks include local and panoramic object detection, segmentation and change understanding, object tracking, and change reversal. Currently available 2D change understanding datasets primarily concentrate on two separate tasks: change detection (changes localization) and change captioning (change content description). Our PanoSCU, targets the simultaneous localization and description of object changes in indoor panoramic 2D images. Although the PanoSCU dataset is artificially generated using the Ai2Thor simulator, it is highly complex. It incorporates 2650 rearrangement scenarios (panorama pairs) with 48 indoor object classes of different sizes. Since the panoramas in PanoSCU are generated from different amounts of images for each scene, they significantly vary in ratios and sizes. This variability presents a challenge for current algorithms, which typically operate with standard-sized image inputs. Moreover, the source images for panoramas are captured by an agent at different times of the day, with different light sources, and from slightly different locations, further increasing the dataset's complexity.