Unable to reproduce the paper reported results #4

Thank you for your great work! However, I have trouble when reproducing your reported results in your paper (i.e., Table 2 and 4). Therefore, I have some questions and I hope you can help me solve them.

• According to the README file, two checkpoints are provided, one fine-tuned from SD 2-1 and one for SD1-5. I wonder which one you utilize to report the results in your paper.

• According to configs/cocostuff_SD2_1.json and configs/cocostuff_SD1_5.json, it seems that you are actually fine-tuning and generating images on 512x512 resolutions instead of 256x256, which is different from your settings in your paper. Moreover, even if I utilize the generated 512x512 using the SD2-1 checkpoint, I cannot get the FID value reported in your paper (I got 22+ FID using the fid_eval.py script). Would you mind providing the exact code settings to reproduce the results in your paper?

"data": {
        "dataset": "coco_stuff_layout_caption_label",
        "root": "/home/ubuntu/disk2/data/COCO",
        "image_size": 512,
        "dataset_args": {
            "train_empty_string": 0, 
            "val_empty_string": 0
        },
        "train_args": {
            "split": "train",
            "data_len": -1
        },
        "val_args": {
            "split": "val",
            "data_len": 1
        },
        "batch_size": 1,
        "val_batch_size": 1
    },
    "sampling_args": {
        "sampling_w_noise": false,
        "image_size": 64,
        "in_channel": 4,
        "num_samples": -1,
        "callbacks": [
            "callbacks.coco_layout.sampling_save_fig.COCOLayoutImageSavingCallback"
        ]
    }

Thank you!