Using YouTube json instead of scraping
See original GitHub issuehttps://m.youtube.com/results?search_query=[query]&app=m
returns search results in json. Maybe using those results would be better than using bs4 (or regex) on the HTML results returned for a normal search (https://www.youtube.com/results?search_query=[query]&app=desktop
).
Pagination might be an issue - how to get the next page for m.youtube.com results?
Issue Analytics
- State:
- Created 4 years ago
- Comments:8 (4 by maintainers)
Top Results From Across the Web
Scraping data from a website into JSON - YouTube
Download ParseHub for Free: https://bit.ly/3np4b8gToday, we'll show you how you can easily scrape data from any website and store the data ...
Read more >Hidden APIs with Scrapy - easy JSON data extraction - YouTube
I've shown this web scraping method before but never using Scrapy, and given that the Scrapy framework gives us some reaslly good features...
Read more >Python Project to Scrape YouTube using YouTube Data API
In this video, we build a Python Project to Scrape YouTube data using YouTube Data API. Using YouTube API, we extract the data...
Read more >How to extract from JSON Links - YouTube
Octoparse is a SIMPLE but POWERFUL web scraping tool for harvesting structured information and specific data types related to the keywords ...
Read more >Python Web Scraping: JSON in SCRIPT tags - YouTube
This video covers a simple and easy way to web scrape with python by getting the data out in JSON format from the...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
You should really think about using youtube-dl because it removes a lot of maintenance work keeping up with youtube.
Why not rely on youtube-dl to get search results? 'ytsearch:query" gives a list of results in youtube-dl In principle if you fully exploit youtube-dl, you’d be able to support any side that the script does, without having to code them yourself. A quick search in youtube-dl gives: