TagUI icon indicating copy to clipboard operation
TagUI copied to clipboard

How would I search for an image on the screen and click on coordinates relative to it?

Open kittyguy14 opened this issue 1 year ago • 1 comments

I want to be able to look for if this image is on the screen and click on it (slightly off-centered on the Y axis because the button is nearer to the bottom of the image) the button and background can be a different color too, so if possible could it just search for a similar image? or would I have to input every possible combination of colors image

kittyguy14 avatar Sep 06 '23 22:09 kittyguy14

If this isn't possible just searching for the button part and clicking on that would work too.

kittyguy14 avatar Sep 06 '23 22:09 kittyguy14

Hi @kittyguy14, the visual automation engine can accept slight variation in image or colour but if it is too different it will not work. But your idea of applying an offset works. You can use mouse_x() and mouse_y(). See example - https://tagui.readthedocs.io/en/latest/reference.html#mouse-x

kensoh avatar Aug 19 '24 12:08 kensoh