question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Visual recognition not finding elements / capture Sikuli visual automation debug info

See original GitHub issue

I have trouble to make the visual automation work. I installed Sikuli as described in the instructions (I think) and when starting a flow Sikuli seems to start in the background.

But when trying to interact with an element there is an error:

ERROR - cannot find example.png on screen

When using the SikuliX IDE in tagui.sikuli to interact with the element it works without a problem.

Issue Analytics

  • State:closed
  • Created 5 years ago
  • Comments:17 (10 by maintainers)

github_iconTop GitHub Comments

2reactions
yolibernalcommented, Jul 14, 2018

I just tested the script with an image taken with the Sikuli IDE and it worked fine. Before I was using a screenshot selection taken with macOS Grab, which produces an image with a much higher resolution than the image taken with the IDE.

Might it be that the handleFindFailed occurs due to timeout caused by the higher resolution? I imagine that the algorithm would take much longer to execute in that case. Or Grab changes the image slightly when saving.

1reaction
kensohcommented, Mar 17, 2021

Hi Abhi, thanks for sharing your findings I appreciate it! I hear before a friend was saying some Retina display the resolution density is higher, so snapshots captured with the defaulting image capture tool may be different from what computer sees.

This is the issue with details on this Retina display issue and solution. User changed the PPI from 144 to 72 to get it working.

https://github.com/kelaberetiv/TagUI/issues/896#issuecomment-753711855

Read more comments on GitHub >

github_iconTop Results From Across the Web

Visual recognition not finding elements / capture Sikuli visual ...
I have trouble to make the visual automation work. I installed Sikuli as described in the instructions (I think) and when starting a...
Read more >
Introduction to Sikuli (GUI Automation Tool)
Sikuli Automates anything you see on the screen using the image recognition method to identify GUI elements. Sikuli script allows users to ...
Read more >
10 Sikuli Best Practices - CLIMB
Sikuli is a visual automation tool that uses image recognition to identify and interact with elements on the screen. This means it relies ......
Read more >
getting find failed errors in sikuli - Stack Overflow
Coming to capturing the images, i have seen that if i use the default screen capture present (CMD + SHT + 4) in...
Read more >
Sikulix Cant Find Image - ADocLib
Sikuli is a tool for Visual Automation and Testing using images to locate GUI elements on the screen and allows to act on...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found