Windows touch and/or mouse injection.

[sasa42]

Would it be possible to interact on the received texture with the mouse. The mouse movement is ececuted on the sender window?

[hecomi]

Sorry for my late reply... You can not interact the window captured by uWindowCapture directly. But if you get the uv by a raycast and calculate the position in desktop with x, y, width, and height of the window, you can interact it by calling SendMessage Win32API with the position.

[Aminolroaya]

Hello @hecomi. Thanks for your package. I saw that you have worked on interaction: https://www.youtube.com/watch?v=YoFmszqILd4 Also, found UwcRayCastExample.cs in your codes. Is it possible to give more hints or share the code for this issue stream? For example, in wcRayCastExample.cs when the ray hits which of windowCoord = result.windowCoord; or desktopCoord = result.desktopCoord; should be sent to SendMesssage. Can you also how we can SendMessage Win32API with the position? BTW. I also found UTouchInjection repo, but it depends on UDesktopDuplication that does not work for me bc of GPU problem. How can I change that to work with UwindowCapture?

Thanks.

[hecomi]

How to send click message

I have uploaded an example of the code I used in the YouTube video below.

• https://gist.github.com/hecomi/c9037049db7b54b7134efc7fcc8a522f

At that time, I used uTouchInjection to send the click message, but I think SendMouseClick() in the sciprt will also work. The point is to bring the window you want to click on to the forefront. For this purpose, SetForegroundWindow() is called first.

uTouchInjection

If you do not include the Samples directory, the dependency on uDesktopDuplication is removed. If you are installing from .unitypackage, uncheck the uDesktopDuplication + VR sample.

[Aminolroaya]

Thanks for your answer @hecomi.

Regards, Zahra

On Sun, Jan 16, 2022 at 2:30 AM hecomi @.***> wrote:

How to send click message

I have uploaded an example of the code I used in the YouTube video below.

• https://gist.github.com/hecomi/c9037049db7b54b7134efc7fcc8a522f

At that time, I used uTouchInjection to send the click the message, but I think SendMouseClick() in the sciprt will also work. The point is to bring the window you want to click on to the forefront. For this purpose, SetForegroundWindow() is called first. uTouchInjection

If you do not include the Samples directory, the dependency on uDesktopDuplication is removed. If you are installing from .unitypackage, uncheck the uDesktopDuplication + VR sample.

— Reply to this email directly, view it on GitHub https://github.com/hecomi/uWindowCapture/issues/17#issuecomment-1013840921, or unsubscribe https://github.com/notifications/unsubscribe-auth/AD5DX4YRF7ABJB3LHRUBOLLUWKF4PANCNFSM4KKNEGJA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you commented.Message ID: @.***>