question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Hi,

From time to time my engine stop pulling new tasks. From what i see in logs it try to work on old scans. As we can find under timestamp 2021-11-17 09:36:50,649 scan is completed however next logs suggest that the same scan is performed. Till restart no new task are pulled by engine.

I’m working on Scantron 1.43.

2021-11-17 09:34:01,017 [MainThread  ] [engine.py-go()] [INFO] No scan jobs found...checking back in 60 seconds.
2021-11-17 09:35:01,078 [MainThread  ] [engine.py-go()] [INFO] Current scan processes being tracked in SCAN_PROCESS_DICT: {10787: {'popen_object': <subprocess.Popen object at 0x7f325711aa20>, 'scan_status': 'started'}, 14619: {'popen_object': <subprocess.Popen object at 0x7f32570f8748>, 'scan_status': 'started'}}
2021-11-17 09:35:01,078 [MainThread  ] [engine.py-check_for_scan_jobs()] [INFO] check_for_scans URL: https://127.0.0.1:4430/api/scheduled_scans
2021-11-17 09:35:01,109 [MainThread  ] [engine.py-go()] [INFO] No scan jobs found...checking back in 60 seconds.
2021-11-17 09:36:01,169 [MainThread  ] [engine.py-go()] [INFO] Current scan processes being tracked in SCAN_PROCESS_DICT: {10787: {'popen_object': <subprocess.Popen object at 0x7f325711aa20>, 'scan_status': 'started'}, 14619: {'popen_object': <subprocess.Popen object at 0x7f32570f8748>, 'scan_status': 'started'}}
2021-11-17 09:36:01,169 [MainThread  ] [engine.py-check_for_scan_jobs()] [INFO] check_for_scans URL: https://127.0.0.1:4430/api/scheduled_scans
2021-11-17 09:36:01,284 [MainThread  ] [engine.py-go()] [INFO] No scan jobs found...checking back in 60 seconds.
2021-11-17 09:36:50,585 [Thread-2    ] [engine.py-scan_job_handler()] [DEBUG] process.returncode: 0
2021-11-17 09:36:50,585 [Thread-2    ] [engine.py-update_scan_information()] [INFO] update_scan_information URL: https://127.0.0.1:4430/api/scheduled_scans/1620
2021-11-17 09:36:50,649 [Thread-2    ] [engine.py-update_scan_information()] [INFO] Successfully updated scan information for scan ID 1620 with data {'scan_status': 'completed'}
2021-11-17 09:36:50,658 [Thread-2    ] [engine.py-scan_job_handler()] [INFO] Starting scan for site 'XXX-aws-us-west-2', with process ID 19365, and command: masscan --port 0-65535 --rate 2000 -sS -Pn -n --randomize-hosts -v --send-eth -iL ./target_files/XXX_aws_us_west_2__scantron_engine1__20211116_2102.part1.targets -oJ ./scan_results/pending/XXX_aws_us_west_2__scantron_engine1__20211116_2102.part1.json --http-user-agent user-agent
2021-11-17 09:36:50,658 [Thread-2    ] [engine.py-update_scan_information()] [INFO] update_scan_information URL: https://127.0.0.1:4430/api/scheduled_scans/1620
2021-11-17 09:36:50,678 [Thread-2    ] [engine.py-update_scan_information()] [INFO] Successfully updated scan information for scan ID 1620 with data {'scan_status': 'started', 'scan_binary_process_id': 19365}
2021-11-17 09:37:01,344 [MainThread  ] [engine.py-go()] [INFO] Current scan processes being tracked in SCAN_PROCESS_DICT: {14619: {'popen_object': <subprocess.Popen object at 0x7f32570f8748>, 'scan_status': 'started'}, 19365: {'popen_object': <subprocess.Popen object at 0x7f325711a940>, 'scan_status': 'started'}}


2021-11-17 11:05:10,112 [MainThread  ] [engine.py-go()] [INFO] No scan jobs found...checking back in 60 seconds.
2021-11-17 11:06:10,172 [MainThread  ] [engine.py-go()] [INFO] Current scan processes being tracked in SCAN_PROCESS_DICT: {14619: {'popen_object': <subprocess.Popen object at 0x7f32570f8748>, 'scan_status': 'started'}, 19365: {'popen_ob
ject': <subprocess.Popen object at 0x7f325711a940>, 'scan_status': 'started'}}
2021-11-17 11:06:10,172 [MainThread  ] [engine.py-check_for_scan_jobs()] [INFO] check_for_scans URL: https://127.0.0.1:4430/api/scheduled_scans
2021-11-17 11:06:10,206 [MainThread  ] [engine.py-go()] [INFO] No scan jobs found...checking back in 60 seconds.
2021-11-17 11:07:10,267 [MainThread  ] [engine.py-go()] [INFO] Current scan processes being tracked in SCAN_PROCESS_DICT: {14619: {'popen_object': <subprocess.Popen object at 0x7f32570f8748>, 'scan_status': 'started'}, 19365: {'popen_ob
ject': <subprocess.Popen object at 0x7f325711a940>, 'scan_status': 'started'}}
2021-11-17 11:07:10,267 [MainThread  ] [engine.py-check_for_scan_jobs()] [INFO] check_for_scans URL: https://127.0.0.1:4430/api/scheduled_scans
2021-11-17 11:07:10,303 [MainThread  ] [engine.py-go()] [INFO] No scan jobs found...checking back in 60 seconds.
2021-11-17 11:08:10,360 [MainThread  ] [engine.py-go()] [INFO] Current scan processes being tracked in SCAN_PROCESS_DICT: {14619: {'popen_object': <subprocess.Popen object at 0x7f32570f8748>, 'scan_status': 'started'}, 19365: {'popen_ob
ject': <subprocess.Popen object at 0x7f325711a940>, 'scan_status': 'started'}}
2021-11-17 11:08:10,360 [MainThread  ] [engine.py-check_for_scan_jobs()] [INFO] check_for_scans URL: https://127.0.0.1:4430/api/scheduled_scans
2021-11-17 11:08:10,384 [MainThread  ] [engine.py-go()] [INFO] No scan jobs found...checking back in 60 seconds.
2021-11-17 11:09:10,444 [MainThread  ] [engine.py-go()] [INFO] Current scan processes being tracked in SCAN_PROCESS_DICT: {14619: {'popen_object': <subprocess.Popen object at 0x7f32570f8748>, 'scan_status': 'started'}, 19365: {'popen_ob
ject': <subprocess.Popen object at 0x7f325711a940>, 'scan_status': 'started'}}
2021-11-17 11:09:10,444 [MainThread  ] [engine.py-check_for_scan_jobs()] [INFO] check_for_scans URL: https://127.0.0.1:4430/api/scheduled_scans
2021-11-17 11:09:10,464 [MainThread  ] [engine.py-go()] [INFO] No scan jobs found...checking back in 60 seconds.
2021-11-17 11:09:24,661 [Thread-1    ] [engine.py-scan_job_handler()] [DEBUG] process.returncode: 0
2021-11-17 11:09:24,661 [Thread-1    ] [engine.py-update_scan_information()] [INFO] update_scan_information URL: https://127.0.0.1:4430/api/scheduled_scans/1620
2021-11-17 11:09:24,722 [Thread-1    ] [engine.py-update_scan_information()] [INFO] Successfully updated scan information for scan ID 1620 with data {'scan_status': 'completed'}
2021-11-17 11:09:24,731 [Thread-1    ] [engine.py-scan_job_handler()] [INFO] Starting scan for site 'XXX-aws-us-west-2', with process ID 22454, and command: masscan --port 0-65535 --rate 2000 -sS -Pn -n --randomize-hosts -v --send-eth -
iL ./target_files/XXX_aws_us_west_2__scantron_engine1__20211116_2102.part1.targets -oJ ./scan_results/pending/XXX_aws_us_west_2__scantron_engine1__20211116_2102.part1.json --http-user-agent user-agent
2021-11-17 11:09:24,731 [Thread-1    ] [engine.py-update_scan_information()] [INFO] update_scan_information URL: https://127.0.0.1:4430/api/scheduled_scans/1620
2021-11-17 11:09:24,761 [Thread-1    ] [engine.py-update_scan_information()] [INFO] Successfully updated scan information for scan ID 1620 with data {'scan_status': 'started', 'scan_binary_process_id': 22454}
2021-11-17 11:10:10,524 [MainThread  ] [engine.py-go()] [INFO] Current scan processes being tracked in SCAN_PROCESS_DICT: {19365: {'popen_object': <subprocess.Popen object at 0x7f325711a940>, 'scan_status': 'started'}, 22454: {'popen_ob
ject': <subprocess.Popen object at 0x7f32570f89e8>, 'scan_status': 'started'}}
2021-11-17 11:10:10,524 [MainThread  ] [engine.py-check_for_scan_jobs()] [INFO] check_for_scans URL: https://127.0.0.1:4430/api/scheduled_scans
2021-11-17 11:10:10,558 [MainThread  ] [engine.py-go()] [INFO] No scan jobs found...checking back in 60 seconds.
2021-11-17 11:11:10,618 [MainThread  ] [engine.py-go()] [INFO] Current scan processes being tracked in SCAN_PROCESS_DICT: {19365: {'popen_object': <subprocess.Popen object at 0x7f325711a940>, 'scan_status': 'started'}, 22454: {'popen_ob
ject': <subprocess.Popen object at 0x7f32570f89e8>, 'scan_status': 'started'}}

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:10 (5 by maintainers)

github_iconTop GitHub Comments

1reaction
jacekjaroscommented, Nov 25, 2021

hi @opsdisk

/home/scantron/console/scan_results/pending is clean up, engine box is rebooted.

root@scantron-engine1:~# uptime
 17:39:21 up 2 min,  1 user,  load average: 0.02, 0.02, 0.00
0reactions
jacekjaroscommented, Dec 14, 2021

hi @opsdisk,

please close.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Category:Glitch Engines | Besiege Wiki - Fandom
Engines are machines designed to leverage or exploit glitches in the physics engine to either useful or hilarious results. Some are stable, some...
Read more >
GLITCH STUDIO: Home
Welcome to Glitch Games Studios ! Since our foundation in 2019, ... We use this wonderful 2D/3D game engine for a great number...
Read more >
Unreal Engine 5.0.3 Editor UI Glitch - Feedback & Requests
The UI in Unreal Engine 5.0.3 editor keeps glitching. Whenever I hover over something, the UI seems to scale the entire screen, ...
Read more >
Glitch Engine - SoundCloud
Play Glitch Engine on SoundCloud and discover followers on SoundCloud | Stream tracks, albums, playlists on desktop and mobile.
Read more >
The engine glitch has made GT7 fun again. : r/granturismo
The engine glitch has made GT7 fun again. For the first time for a while I am really enjoying the game. I don't...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found