Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

How to save particular result in csv when parsing from CLI ?

See original GitHub issue

I’m parsing fb pate from CLI like that:

facebook-scraper --filename nintendo_page_posts.csv --pages 5000 --cookies my_cookies.json nintendo

I parse many-many pages (try to parse all page posts once) and often get different errors (block, timeout, network error, etc). After that all hours of my work are lost. It there any option to save .csv file (maybe with different extension f.e. .csv.partial), even if error ocured ?

Issue Analytics

State:
Created 2 years ago
Comments:6

Top GitHub Comments

1reaction

neon-ninjacommented, Aug 15, 2021

https://github.com/kevinzg/facebook-scraper/commit/c61f3487612de418bf81b69e8b5cc981eecb4e0f should harden CLI post extraction a bit, catching exceptions and then writing out the CSV anyway. I would also recommend increasing the timeout with the timeout parameter if you’re running into timeout issues.

0reactions

neon-ninjacommented, Aug 23, 2021

That could be because the TemporarilyBanned exception is caught. It would still be logged in that case. Also note that the way the scraper detects temp bans, is by looking for the following page titles:

                "you can't use this feature at the moment",
                "you can't use this feature right now",
                "you’re temporarily blocked",

If your FB language is set to something other than English, then the title wouldn’t match those.