Weird empty result response

On Python 3.7

>>> serp = 'asereje'
>>> YoutubeSearch(serp, max_results=1).to_dict()
[{'title': 'Las Ketchup - The Ketchup Song (Asereje) (Spanish Version) (Official Video)', 'link': '/watch?v=V0PisGe66mY', 'id': 'V0PisGe66mY'}]
>>> YoutubeSearch(serp, max_results=1).to_dict()
[]
>>> YoutubeSearch(serp, max_results=1).to_dict()
[{'title': 'Las Ketchup - The Ketchup Song (Asereje) (Spanish Version) (Official Video)', 'link': '/watch?v=V0PisGe66mY', 'id': 'V0PisGe66mY'}]

[alexmercerind]

Now YouTube randomly returns two types of responses, one within JavaScript and other as HTML… Now we cannot scrape using BeautifulSoup.

I have separately written another script here completely from scratch (without any third party library) and is working with both types of responses.

Feel free to use: https://github.com/alexmercerind/youtube-search-python

It has lot more information in its search result.

[andrscyv]

Hey guys, I’ve had the same issues and tried a new approach (no web scrapping ) on the script I was working on . Right now it is working, you can check it here https://github.com/andrscyv/fast_youtube_search

I got the endpoint that youtube uses to load the results of a search, it’s actually the same url but it needs other headers. It returns json but with a very weird structure although it is possible to recover the results from it.