feat: Support for touch/pen input in WPF

[MartinZikmund]

trafficstars

GitHub Issue (If applicable): closes https://github.com/unoplatform/uno/issues/15542

PR Type

What kind of change does this PR introduce?

• Feature

What is the current behavior?

What is the new behavior?

PR Checklist

Please check if your PR fulfills the following requirements:

• [ ] Docs have been added/updated which fit documentation template (for bug fixes / features)
• [ ] Unit Tests and/or UI Tests for the changes have been added (for bug fixes / features) (if applicable)
• [ ] Validated PR Screenshots Compare Test Run results.
• [x] Contains NO breaking changes
• [x] Associated with an issue (GitHub or internal) and uses the automatic close keywords.
• [x] Commits must be following the Conventional Commits specification.

[unodevops]

🤖 Your Docs stage site is ready! Visit it here: https://unodocsprstaging.z13.web.core.windows.net/pr-15543/index.html

[unodevops]

🤖 Your WebAssembly Sample App stage site is ready! Visit it here: https://unowasmprstaging.z20.web.core.windows.net/pr-15543/index.html

[nventive-devops]

The build 113256 found UI Test snapshots differences: android-28-net7: 0, android-28-net7-Snap: 52, ios: 175, ios-Snap: 676, skia-gtk-screenshots: 17, skia-wpf-screenshots: 18, wasm: 72, wasm-automated-net7.0-UWP-Default-automated: 30, wasm-automated-net7.0-UWP-RuntimeTests-0: 0, wasm-automated-net7.0-UWP-RuntimeTests-1: 0, wasm-automated-net7.0-UWP-RuntimeTests-2: 1, wasm-automated-net7.0-WinUI-Benchmarks-automated: 0, wasm-automated-net7.0-WinUI-RuntimeTests-0: 0, wasm-automated-net7.0-WinUI-RuntimeTests-1: 0, wasm-automated-net7.0-WinUI-RuntimeTests-2: 0

Details

• android-28-net7: 0 changed over 1

• android-28-net7-Snap: 52 changed over 1051

  🚨🚨 Comparison Details (first 20) 🚨🚨

  • Icons_UITests_Microsoft_UI_Xaml_Controls_ImageIconTests_ImageIconPage_UITests_Microsoft_UI_Xaml_Controls_ImageIconTests_ImageIconPage
  • Icons_UITests_Shared_Windows_UI_Xaml_Controls_BitmapIconTests_BitmapIcon_Foreground_UITests_Shared_Windows_UI_Xaml_Controls_BitmapIconTests_BitmapIcon_Foreground
  • Default_SamplesApp_Wasm_Windows_UI_Xaml_Controls_ListView_ListView_IsSelected_SamplesApp_Wasm_Windows_UI_Xaml_Controls_ListView_ListView_IsSelected
  • ListView_ListView_With_ListViews_Count_Measure_UITests_Shared_Windows_UI_Xaml_Controls_ListView_ListView_With_ListViews_Count_Measure
  • GridView_GenericApp_Views_Samples_Shared_Content_UITests_GridViewMultipleSelectionMode_GenericApp_Views_Samples_Shared_Content_UITests_GridViewMultipleSelectionMode
  • Image_UITests_Windows_UI_Xaml_Controls_ImageTests_SvgImageSource_Icons_UITests_Windows_UI_Xaml_Controls_ImageTests_SvgImageSource_Icons
  • Image_UITests_Windows_UI_Xaml_Controls_ImageTests_SvgImageSource_FromMsAppData_UITests_Windows_UI_Xaml_Controls_ImageTests_SvgImageSource_FromMsAppData
  • Image_UITests_Windows_UI_Xaml_Controls_ImageTests_SvgImageSource_FromStream_UITests_Windows_UI_Xaml_Controls_ImageTests_SvgImageSource_FromStream
  • MUX_UITests_Microsoft_UI_Xaml_Controls_SplitButtonTests_SplitButtonTestsPage_UITests_Microsoft_UI_Xaml_Controls_SplitButtonTests_SplitButtonTestsPage
  • Progress_UITests_Windows_UI_Xaml_Controls_ProgressRing_WindowsProgressRing_GH1220_UITests_Windows_UI_Xaml_Controls_ProgressRing_WindowsProgressRing_GH1220
  • SwipeControl_MUXControlsTestApp_SwipeControlPage2_MUXControlsTestApp_SwipeControlPage2
  • MediaPlayerElement_Using_mkv_UITests_Shared_Windows_UI_Xaml_Controls_MediaPlayerElement_MediaPlayerElement_Mkv_Extension
  • MediaPlayerElement_Using_mov_UITests_Shared_Windows_UI_Xaml_Controls_MediaPlayerElement_MediaPlayerElement_Mov_Extension
  • MediaPlayerElement_Using_mp3_Audio_only_UITests_Shared_Windows_UI_Xaml_Controls_MediaPlayerElement_MediaPlayerElement_Mp3_Extension
  • MediaPlayerElement_Using_ogg_UITests_Shared_Windows_UI_Xaml_Controls_MediaPlayerElement_MediaPlayerElement_Ogg_Extension
  • Focus_GetFocus_Uno_UI_Samples_Content_UITests_FocusTests_FocusManager_GetFocus_Automated
  • Focus_UITests_Windows_UI_Xaml_FocusTests_Focus_FocusCycle_UITests_Windows_UI_Xaml_FocusTests_Focus_FocusCycle
  • NavigationView_MUXControlsTestApp_NavigationViewTopNavPage_MUXControlsTestApp_NavigationViewTopNavPage
  • Scrolling_ScrollViewer_Content_Smaller_Than_Viewport_UITests_Shared_Windows_UI_Xaml_Controls_ScrollViewerTests_ScrollViewer_Content_Smaller_Than_Viewport
  • RatingControl_UITests_Microsoft_UI_Xaml_Controls_RatingControlTests_RatingControlPage_UITests_Microsoft_UI_Xaml_Controls_RatingControlTests_RatingControlPage

• ios: 175 changed over 266

  🚨🚨 Comparison Details (first 20) 🚨🚨

  • CheckBox_IsEnabled_Validation_Uno_UI_Samples_Content_UITests_ButtonTestsControl_CheckBox_IsEnabled_Automated
  • ContentControl_Changing_ContentTemplate_Uno_UI_Samples_Content_UITests_ContentControlTestsControl_ContentControl_Changing_ContentTemplate
  • Image_Margins_Identical_WriteableBitmap_Invalidate_-_Result
  • Keyboard_Textbox_NoScrollViewer_Validation_5_-_Remove_Focus_on_numberTextBox
  • Screenshots_Image_Stretch_Algmnt_Inf_Horizontal_Mode-3
  • Screenshots_Image_Stretch_Algmnt_Inf_Vertical_Mode-0
  • SelectionTest_UITests_Microsoft_UI_Xaml_Controls_RadioButtonsTests_RadioButtonsPage
  • SequentialAnimations_SamplesApp_Windows_UI_Xaml_Media_Animation_SequentialAnimationsPage
  • UpDownTest_UITests_Shared_Microsoft_UI_Xaml_Controls_NumberBoxTests_NumberBoxPage
  • CheckBox_DoubleTapValidation_Uno_UI_Samples_Content_UITests_ButtonTestsControl_CheckBox_IsEnabled_Automated
  • FocusManager_FocusDirection_Down_Validation_Uno_UI_Samples_Content_UITests_FocusTests_FocusManager_FocusDirection
  • Image_Source_Nullify_image_source_nullify_empty
  • Keyboard_Textbox_NoScrollViewer_Validation_4_-_Remove_Focus_on_multilineTextBox
  • Screenshots_Image_Stretch_Alignment_SizeOnControl_Mode-2
  • Screenshots_Image_Stretch_Alignment_SizeOnControl_Mode-3
  • TextBox_TextChanged_UITests_Shared_Windows_UI_Xaml_Controls_TextBoxTests_TextBox_TextChanged
  • TextBox_TextChanging_Capitalize_UITests_Shared_Windows_UI_Xaml_Controls_TextBoxTests_TextBox_TextChanging
  • When_MaxLines_Changed_With_TextWrapping_UITests_Shared_Windows_UI_Xaml_Controls_TextBlockControl_SimpleText_MaxLines_Different_Font_Size
  • When_MaxLines_Then_AlignmentPositionIsCorrect_Uno_UI_Samples_Content_UITests_TextBlockControl_SimpleText_MaxLines_Two_With_Wrap
  • CheckBox_IsEnabled_StatePreservation_Uno_UI_Samples_Content_UITests_ButtonTestsControl_CheckBox_IsEnabled_Automated

• ios-Snap: 676 changed over 1042

  🚨🚨 Comparison Details (first 20) 🚨🚨

  • AutoSuggestBox_BasicAutoSuggestBox_UITests_Shared_Windows_UI_Xaml_Controls_AutoSuggestBoxTests_BasicAutoSuggestBox
  • Border_AutoBorderStretchwithtopmargin_Uno_UI_Samples_UITests_BorderTestsControl_AutoBorderStretchwithtopmargin
  • Border_Border_CornerRadius_BorderThickness_UITests_Windows_UI_Xaml_Controls_BorderTests_Border_CornerRadius_BorderThickness
  • Border_OnepxThicknessandRadiusAndTextBlock_Uno_UI_Samples_UITests_BorderTestsControl_OnepxThicknessandRadiusAndTextBlock
  • Border_UITests_Windows_UI_Xaml_Controls_BorderTests_Border_LinearGradientBrush_UITests_Windows_UI_Xaml_Controls_BorderTests_Border_LinearGradientBrush
  • Brushes_Uno_UI_Samples_UITests_ImageBrushTestControl_DoubleImageBrushInList_Uno_UI_Samples_UITests_ImageBrushTestControl_DoubleImageBrushInList
  • Clipping_SamplesApp_Windows_UI_Xaml_Clipping_Transform_Ellipse_In_Canvas_in_Two_Grids_SamplesApp_Windows_UI_Xaml_Clipping_Transform_Ellipse_In_Canvas_in_Two_Grids
  • Clipping_SamplesApp_Windows_UI_Xaml_Clipping_Transform_Ellipse_in_Canvas_SamplesApp_Windows_UI_Xaml_Clipping_Transform_Ellipse_in_Canvas
  • ComboBox_ComboBox_NoDataContext_UITests_Shared_Windows_UI_Xaml_Controls_ComboBox_ComboBox_NoDataContext
  • ComboBox_ComboBox_Picker_SamplesApp_Wasm_Windows_UI_Xaml_Controls_ComboBox_ComboBox_Picker
  • Default_UITests_Windows_UI_Xaml_Controls_Canvas_Grid_ZIndex_UITests_Windows_UI_Xaml_Controls_Canvas_Grid_ZIndex
  • Default_UITests_Windows_UI_Xaml_Controls_ComboBox_ComboBox_Dropdown_Background_4418_UITests_Windows_UI_Xaml_Controls_ComboBox_ComboBox_Dropdown_Background_4418
  • Dialogs_UITests_Shared_MessageDialogTests_MessageDialogTest_UITests_Shared_MessageDialogTests_MessageDialogTest
  • Dialogs_UITests_Windows_UI_Xaml_Controls_ContentDialogTests_ContentDialog_Dialogs_UITests_Windows_UI_Xaml_Controls_ContentDialogTests_ContentDialog_Dialogs
  • Flyouts_MenuFlyout_DroidAltTab_UITests_Windows_UI_Xaml_Controls_MenuFlyoutTests_MenuFlyout_DroidAltTab
  • Flyouts_MenuFlyout_IosNative_UITests_Shared_Windows_UI_Xaml_Controls_MenuFlyoutTests_MenuFlyout_IosNative
  • Focus_FocusManagerTest_Uno_UI_Samples_Content_UITests_FocusTests_FocusManagerTest
  • Focus_GetFocus_Uno_UI_Samples_Content_UITests_FocusTests_FocusManager_GetFocus_Automated
  • Grid_Grid_with_Fixed_Size_Uno_UI_Samples_Content_UITests_GridTestsControl_Grid_with_Fixed_Size
  • Grid_Grid_with_OutOfRange_Cells_UITests_Shared_Windows_UI_Xaml_Controls_GridTestsControl_Grid_with_OutOfRange_Cells

• skia-gtk-screenshots: 17 changed over 1101

  🚨🚨 Comparison Details (first 20) 🚨🚨

  • MediaPlayerElement-Using .mp3 (Audio only).png
  • Microsoft.UI.Composition-CompositionMaskBrush.png
  • Microsoft.UI.Composition-RedirectVisual.png
  • Progress-WindowsProgressRing_GH1220.png
  • Automation-AutomationProperties_Name.png
  • Progress-ProgressRingHeightTest.png
  • ListView-ListViewSelectedItems.png
  • MUX-WinUIProgressRingPage.png
  • Image-ImageSourceStream.png
  • Microsoft.UI.Composition-CompositionVisualSurface.png
  • Progress-WinUIProgressRing_Features.png
  • PipsPager-PipsPagerExamples.png
  • WinUI-PipsPagerExamples.png
  • DragAndDrop-DragDrop_TestPage.png
  • MUX-WinUIProgressRing_CustomSources.png
  • Progress-WinUIProgressRingPage.png
  • Progress-WinUIProgressRing_CustomSources.png

• skia-wpf-screenshots: 18 changed over 1101

  🚨🚨 Comparison Details (first 20) 🚨🚨

  • MUX-WinUIProgressRingPage.png
  • MUX-WinUIProgressRing_CustomSources.png
  • DragAndDrop-DragDrop_TestPage.png
  • Microsoft.UI.Composition-CompositionVisualSurface.png
  • Microsoft.UI.Composition-RedirectVisual.png
  • Brushes-ImageBrushChangingCornerRadius.png
  • ListView-ListViewSelectedItems.png
  • Image-UniformToFill100x100.png
  • PipsPager-PipsPagerExamples.png
  • Image-Image_Stretch.png
  • Progress-ProgressRingHeightTest.png
  • Progress-WindowsProgressRing_GH1220.png
  • Microsoft.UI.Composition-CompositionMaskBrush.png
  • Progress-WinUIProgressRing_CustomSources.png
  • Progress-WinUIProgressRing_Features.png
  • Transform-TransformToVisual_Translate2d.png
  • Progress-WinUIProgressRingPage.png
  • WinUI-PipsPagerExamples.png

• wasm: 72 changed over 1047

  🚨🚨 Comparison Details (first 20) 🚨🚨

  • GenericApp.Views.Samples.Shared.Content.UITests.GridViewMultipleSelectionMode
  • SamplesApp.Windows_UI_Xaml_Controls.ListView.HorizontalListView_Templates
  • SamplesApp.Windows_UI_Xaml_Controls.ListView.ListViewWithinScollViewer
  • UITests.Windows_UI_Xaml_Controls.SymbolIconTests.SymbolIcon_Generic
  • UITests.Microsoft_UI_Xaml_Controls.ProgressRing.WinUIProgressRing_Features
  • UITests.Shared.Microsoft_UI_Xaml_Controls.TwoPaneViewTests.TwoPaneViewPage
  • UITests.Shared.Windows_UI_Xaml_Controls.ListView.ListView_Margin_On_Container
  • UITests.Shared.Windows_UI_Xaml_Controls.TextBoxTests.TextBox_Disabled
  • Uno.UI.Samples.Content.UITests.TextBoxControl.Input_Test_NoScrollViewer_Automated
  • Uno.UI.Samples.Content.UITests.TextBoxControl.Input_With_PlaceholderText
  • UITests.Microsoft_UI_Xaml_Controls.ProgressRing.ProgressRingHeightTest
  • UITests.Shared.Windows_ApplicationModel.Email.EmailManagerTests
  • UITests.Shared.Windows_UI_Xaml.Enability.BasicEnability
  • UITests.Windows_UI_Xaml_Controls.ImageTests.SvgImageSource_Basic
  • UITests.Windows_UI_Xaml_Controls.TextBox.TextBox_SelectionHighlightColor
  • Uno.UI.Samples.Content.UITests.GridView.GridView_Item_TextBlock_And_Button
  • MUXControlsTestApp.RefreshVisualizerPage
  • SamplesApp.Samples.Microsoft_UI_Xaml_Controls.NavigationViewTests.FluentStyle.FluentStyle_NavigationViewSample
  • SamplesApp.Samples.NavigationViewSample.NavigationViewSample
  • SamplesApp.Windows_UI_Xaml_Controls.ListView.ListView_Changing_Text

• wasm-automated-net7.0-UWP-Default-automated: 30 changed over 1951

  🚨🚨 Comparison Details (first 20) 🚨🚨

  • MediaPlayerElement_Mini_player_UITests_Shared_Windows_UI_Xaml_Controls_MediaPlayerElement_MediaPlayerElement_Minimal
  • MediaPlayerElement_Sources_UITests_Shared_Windows_UI_Xaml_Controls_MediaPlayerElement_MediaPlayerElement_Sources
  • ColorPicker_WinUIColorPickerPage_UITests_Shared_Microsoft_UI_Xaml_Controls_ColorPickerTests_WinUIColorPickerPage
  • ListView_SelectedItems_SamplesApp_Windows_UI_Xaml_Controls_ListView_ListViewSelectedItems
  • ListView_ListViewSelectedItems_SamplesApp_Windows_UI_Xaml_Controls_ListView_ListViewSelectedItems
  • MediaPlayerElement_MediaPlayerElement_Stretch_Fill_UITests_Shared_Windows_UI_Xaml_Controls_MediaPlayerElement_MediaPlayerElement_Stretch_Fill
  • PipsPager_MUXControlsTestApp_PipsPagerExamples_MUXControlsTestApp_PipsPagerExamples
  • Automation_UITests_Shared_Windows_UI_Xaml_Automation_AutomationProperties_Name_UITests_Shared_Windows_UI_Xaml_Automation_AutomationProperties_Name
  • Progress_UITests_Microsoft_UI_Xaml_Controls_ProgressRing_WinUIProgressRingPage_UITests_Microsoft_UI_Xaml_Controls_ProgressRing_WinUIProgressRingPage
  • Progress_UITests_Microsoft_UI_Xaml_Controls_ProgressRing_WinUIProgressRing_CustomSources_UITests_Microsoft_UI_Xaml_Controls_ProgressRing_WinUIProgressRing_CustomSources
  • Progress_UITests_Microsoft_UI_Xaml_Controls_ProgressRing_WinUIProgressRing_Features_UITests_Microsoft_UI_Xaml_Controls_ProgressRing_WinUIProgressRing_Features
  • Progress_UITests_Windows_UI_Xaml_Controls_ProgressRing_WindowsProgressRing_GH1220_UITests_Windows_UI_Xaml_Controls_ProgressRing_WindowsProgressRing_GH1220
  • TextBlock_TextBlockSimpleContrainedHorizontalCenterWrap2_Uno_UI_Samples_Content_UITests_TextBlockControl_TextBlockSimpleContrainedHorizontalCenterWrap2
  • TextBlock_Textblocktimespancustomformat_Uno_UI_Samples_Content_UITests_TextBlockControl_Textblocktimespancustomformat
  • TextBlock_TextBlockTimespan_Uno_UI_Samples_Content_UITests_TextBlockControl_TextBlockTimespan
  • UpDownTest_UITests_Shared_Microsoft_UI_Xaml_Controls_NumberBoxTests_NumberBoxPage
  • TextBlock_TextBlockMultilineInStarStackPanel_Uno_UI_Samples_Content_UITests_TextBlockControl_TextBlockMultilineInStarStackPanel
  • MediaPlayerElement_Using_3gp_UITests_Shared_Windows_UI_Xaml_Controls_MediaPlayerElement_MediaPlayerElement_3gp_Extension
  • MediaPlayerElement_Using_flv_UITests_Shared_Windows_UI_Xaml_Controls_MediaPlayerElement_MediaPlayerElement_Flv_Extension
  • SequentialAnimations_SamplesApp_Windows_UI_Xaml_Media_Animation_SequentialAnimationsPage

• wasm-automated-net7.0-UWP-RuntimeTests-0: 0 changed over 1

• wasm-automated-net7.0-UWP-RuntimeTests-1: 0 changed over 1

• wasm-automated-net7.0-UWP-RuntimeTests-2: 1 changed over 1

  🚨🚨 Comparison Details (first 20) 🚨🚨

  • RunRuntimeTests_SamplesApp_Samples_UnitTests_UnitTestsPage

• wasm-automated-net7.0-WinUI-Benchmarks-automated: 0 changed over 1

• wasm-automated-net7.0-WinUI-RuntimeTests-0: 0 changed over 1

• wasm-automated-net7.0-WinUI-RuntimeTests-1: 0 changed over 1

• wasm-automated-net7.0-WinUI-RuntimeTests-2: 0 changed over 1

[lindexi]

Awesome. I'm really looking forward to this feature. Thank you!

[lindexi]

Does this feature include in the UNO version of 5.1.80 ?

And I test fail with the UNO version of 5.1.80, and it still does not support multiple touch in WPF.

[Youssef1313]

@lindexi I don't think this PR implements multi touch. It was only intended for proper detection of the pointer device type.