Unable to click on Text Element which is show as a pointer when hovers mouse to

Hi,

My Cordova UWP app has some TEXT elements which will show a drop-down menu after clicking on it. Those elements are TEXT element as shown in the Page Source. On the app, when the mouse is pointed at them, we can click to open the drop-down menu.

Can we have a fix on that so WinAppDriver can click on this type of TEXT element? I’m using Appium v1.7.1 and WinAppDriver v0.7 (I guess, as WinAppDriver is installed along with Appium).

Error message:

[WinAppDriver] [STDOUT] {"status":105,"value":{"error":"element not interactable","message":"An element command could not be completed because the element is not pointer- or keyboard interactable."}}
[MJSONWP] Encountered internal error running command:  {"jsonwp":{"status":105,"value":{"error":"element not interactable","message":"An element command could not be completed because the element is not pointer- or keyboard interactable."}}} ProxyRequestError: Could not proxy command to remote server. Original error: 400 - {"status":105,"value":{"error":"element not interactable","message":"An element command could not be completed because the element is not pointer- or keyboard interactable."}}

Page Source XML:

<Text AcceleratorKey="" AccessKey="" AutomationId="" ClassName="" FrameworkId="MicrosoftEdge"
                          HasKeyboardFocus="False" HelpText="" IsContentElement="True" IsControlElement="True"
                          IsEnabled="True" IsKeyboardFocusable="False" IsOffscreen="True" IsPassword="False"
                          IsRequiredForForm="False" ItemStatus="" ItemType="" LocalizedControlType="text" Name="すべて"
                          Orientation="None" ProcessId="6488" RuntimeId="42.3543334.2.787" x="463" y="56" width="43"
                          height="32"/>

Thanks and Regards

[sachinDV]

Menu item’s sub item is showing isOffscreen false,but it is visible.How to select this with WinAppDriver?

[timotiusmargo]

Hi @watarus-nt,

Sorry for the long delay as this issue slipped through. We actually have some sample scenarios below demonstrating ad-hoc mouse actions such as moving and clicking. I.e. https://github.com/Microsoft/WinAppDriver/blob/v1.0/Tests/WebDriverAPI/Mouse.cs#L55 https://github.com/Microsoft/WinAppDriver/blob/v1.0/Tests/WebDriverAPI/Mouse.cs#L117

The MouseDownMoveUp sample test covers the ad-hoc mouse move where you can additionally specify the offset from the target element coordinate as follows:

// Send mouse down, move, and up actions combination to perform a drag and drop 
// action on the app title bar. These actions reposition Calculator window.
session.Mouse.MouseMove(appNameTitle.Coordinates);
session.Mouse.MouseDown(null); // Pass null as this command omit the given parameter
session.Mouse.MouseMove(appNameTitle.Coordinates, offset, offset);
session.Mouse.MouseUp(null); // Pass null as this command omit the given parameter

Similar ad-hoc touch actions examples can also be found on the sample tests below: https://github.com/Microsoft/WinAppDriver/blob/v1.0/Tests/WebDriverAPI/TouchDownMoveUp.cs#L48 https://github.com/Microsoft/WinAppDriver/blob/v1.0/Tests/WebDriverAPI/TouchDownMoveUp.cs#L75

Hope this helps.