verifyPaparazziRelease --rerun-tasks always successful

[mshearer123]

Description Running ./gradlew verifyPaparazziRelease --rerun-tasks always passes. Except the images change and the report shows the difference.

Expected behavior verifyPaparazziRelease after changing a composable should fail.

Additional information:

• Paparazzi Version: 1.0.0
• OS: MacOS Monterey (M1 Pro)
• Compile SDK: 31
• Gradle Version: 7.4.2
• Android Gradle Plugin Version: 7.1.1

Screenshots paparazzi.zip

[Dambakk]

I'm experiencing the same thing, and have done some more research on #453.

[mshearer123]

I'm not sure it's the same @Dambakk , I think the tasks run, but I would expect the verify task to fail.

[Dambakk]

Ah, I guess you're right. Anyway, I think I experience your issue: https://github.com/cashapp/paparazzi/issues/453#issuecomment-1155523277

[novachevskyi]

@mshearer123 I'm facing the same issue testing with a simple Compose screen. Have you found any solution?

@Dambakk your scenario didn't help, unfortunately.

[mshearer123]

@novachevskyi nope, no luck yet

[jrodbx]

@mshearer123 I wonder if the difference was below the 0.1% threshold. In those cases, it is possible to get a verify to pass (because it's small enough of a difference) but still get a new image on a composable change.

Can you provide a sample/repro? Without that, it's hard for me to dig deeper.

[jrodbx]

Closing due to inactivity, please re-open if the issue re-appears.