Stuck on an issue?
Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.
And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.
Scraping using cookies the individual post has issue on particular posts
See original GitHub issueThis post is kinda different from usual posts while extracting many fields are returned null, specially username etc…
@neon-ninja please check
{
"original_request_url":"https://m.facebook.com/5693291367409366",
"post_url":"https://m.facebook.com/5693291367409366_5693653727373130",
"post_id":"5693291367409366_5693653727373130",
"text":null,
"post_text":null,
"shared_text":null,
"time":"2021-07-15 22:49:30",
"image":"https://scontent-hou1-1.xx.fbcdn.net/v/t1.6435-9/fr/cp0/e15/q65/217386849_5693291370742699_2120901357118796727_n.jpg?_nc_cat=102&ccb=1-3&_nc_sid=da1649&efg=eyJpIjoidCJ9&_nc_ohc=Kp41oHK9b4AAX8JLqsG&_nc_ht=scontent-hou1-1.xx&oh=697bc556e7cd51c3efdcd1c057c52fd5&oe=60F7BF27",
"image_lowquality":null,
"images":[
"https://scontent-hou1-1.xx.fbcdn.net/v/t1.6435-9/fr/cp0/e15/q65/217386849_5693291370742699_2120901357118796727_n.jpg?_nc_cat=102&ccb=1-3&_nc_sid=da1649&efg=eyJpIjoidCJ9&_nc_ohc=Kp41oHK9b4AAX8JLqsG&_nc_ht=scontent-hou1-1.xx&oh=697bc556e7cd51c3efdcd1c057c52fd5&oe=60F7BF27"
],
"images_description":[
],
"images_lowquality":[
],
"images_lowquality_description":[
],
"video":null,
"video_duration_seconds":null,
"video_height":null,
"video_id":null,
"video_quality":null,
"video_size_MB":null,
"video_thumbnail":null,
"video_watches":null,
"video_width":null,
"likes":0,
"comments":1,
"shares":0,
"link":null,
"user_id":null,
"username":null,
"user_url":null,
"is_live":false,
"factcheck":null,
"shared_post_id":null,
"shared_time":null,
"shared_user_id":null,
"shared_username":null,
"shared_post_url":null,
"available":true,
"comments_full":[
{
"comment_id":"5693653727373130",
"comment_url":"https://facebook.com/5693653727373130",
"commenter_id":"100000494192711",
"commenter_url":"https://facebook.com/santiago.canencio?fref=nf&rc=p&__tn__=R",
"commenter_name":"Nates Cruz",
"commenter_meta":null,
"comment_text":"Se muere quien escribe mas no sus letras y cultura, qdep...",
"comment_time":"2021-07-15 00:00:00",
"comment_image":null,
"replies":[
]
}
],
"reactors":null,
"w3_fb_url":null,
"reactions":null,
"reaction_count":null,
"fetched_time":"2021-07-17 22:08:07"
}
Issue Analytics
- State:
- Created 2 years ago
- Comments:5 (4 by maintainers)
Top Results From Across the Web
Scrape Forum posts from a specific user using Beautiful soup
I am a complete python newbie and for my first project, I am trying to scrape posts from a specific user at a...
Read more >How to scrape Instagram posts, comments, and photos
Web scrape Instagram with our unofficial Instagram API to extract Instagram profile data, comments, hashtags, likes, locations, and photos.
Read more >Facebook Post Scraping and Text Analytics | by Eason - Medium
In this story, I will share how to scrape Facebook post data and perform sentiment analysis and key phrase extraction via Azure Text...
Read more >Advanced Python Web Scraping: Best Practices & Workarounds
Here are some helpful tips for web scraping with Python. ... easy as making a POST request with username and password or storing...
Read more >Web Scraping with Python: Everything you need to know (2022)
Learn about web scraping in Python with this step-by-step tutorial. We will cover almost all of the tools Python offers to scrape the...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
@neon-ninja thanks it worked
scraped again but unfortunately some comments were scraped but the result is the same. I scraped again with the same code