moondream icon indicating copy to clipboard operation
moondream copied to clipboard

Use Case: Software UI Testing

Open abdksyed opened this issue 3 months ago • 0 comments

Is there any way to do UI testing, like compare two screenshots of a UI and see if there are any changes in the new UI screenshot when compared to the older screenshot.

I did tried making a collage of both images side by side, and ask what is the difference between left and right image, but the model couldn't identify minor UI changes, and hallucinated/incorrect predictions where there were no changes.

abdksyed avatar Nov 21 '24 05:11 abdksyed