Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Having problem crawling a complete profile

See original GitHub issue

root@ubuntu:/home/aria/instagram-profilecrawl# ./crawl_profile.py behzadshishegaran
Extracting information from behzadshishegaran
BEFORE IMG
BEFORE IMG
BEFORE IMG
BEFORE IMG
BEFORE IMG
BEFORE IMG
BEFORE IMG
BEFORE IMG
BEFORE IMG
BEFORE IMG
BEFORE IMG
BEFORE IMG
BEFORE IMG
BEFORE IMG
BEFORE IMG
BEFORE IMG
BEFORE IMG
Traceback (most recent call last):
  File "./crawl_profile.py", line 27, in <module>
    information = extract_information(browser, username)
  File "/home/aria/instagram-profilecrawl/util/extractor.py", line 128, in extract_information
    img, tags, likes, comments = extract_post_info(browser)
  File "/home/aria/instagram-profilecrawl/util/extractor.py", line 68, in extract_post_info
    while (comments[1].text == 'load more comments'):
IndexError: list index out of range

the script quits without any extra data on what happened. what’s the problem here?

Issue Analytics

State:
Created 6 years ago
Comments:5 (2 by maintainers)

Top GitHub Comments

1reaction

tcvieiracommented, Jul 14, 2017

Yeap, need to put a check for empty comment posts. Just made a pull request to fix this #20

0reactions

timgrossmanncommented, Jul 15, 2017

#20

Top Results From Across the Web

Problems to crawl User Profile properties - Albandrod's Memory

The problem was the following: a client has to create a new Test SharePoint ... a full crawl in the search to crawl...

SharePoint 2013 - User Profile Service/ Search Crawl Errors

Hi,. I am having issues with my Development SharePoint 2013 Search Crawl and the fact that it is unable to crawl & index...

6 Ways to Hype Your Backlink Profile With Crawl Data

Here a few specific examples of how you can combine backlink data with crawl data to maximize link equity to your website.

How to Fix Submitted URL has Crawl Issue - YouTube

Video tutorial showing how to fix Submitted URL has crawl issue in Google Search Console https://youtu.be/cYNM19GaWOs to learn more about ...

Moz Can't Crawl Your Site

Troubleshooting Issues Crawling Your Site ... You've just been notified that we're having trouble crawling your site. In order to successfully crawl your...