inference icon indicating copy to clipboard operation
inference copied to clipboard
verified publisher icon mlcommons

SDXL one of the ten reference images' caption generates a disturbing image

Open nvyihengz opened this issue 1 year ago • 2 comments

Hi, caption id 1303 generates an image that looks a bit disturbing. Since in 4.0, we disclosed the images to the public, e.g. https://github.com/mlcommons/inference_results_v4.0/tree/main/closed/NVIDIA/results/DGX-H100_H100-SXM-80GBx8_TRT/stable-diffusion-xl/Offline/accuracy/images, I would like to ask if we can replace 1303 with a different caption or just avoid showing the images in the results directory? We can remove the images after the review period if the latter is preferred. Thanks!

nvyihengz avatar Jul 05 '24 23:07 nvyihengz

Also I think the taskforce agreed to not disclose the compliance images to the public.

nvyihengz avatar Jul 08 '24 17:07 nvyihengz

@pgmpablo157321

  • Add option in submission checker to remove all the stable diffusion images folder, and skip the checks done for the images folder
  • Remove the images from the inference_results_v4.0 repository

pgmpablo157321 avatar Jul 09 '24 17:07 pgmpablo157321