[regression] [patch available] Youtube channel playlists stopped working

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2018.04.25. If it’s not, read this FAQ entry and update. Issues with outdated version will be rejected.

• I’ve verified and I assure that I’m running youtube-dl 2018.04.25

Before submitting an issue make sure you have:

• At least skimmed through the README, most notably the FAQ and BUGS sections
• Searched the bugtracker for similar issues including closed ones
• Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

• Bug report (encountered problems with youtube-dl)
• Site support request (request for adding support for a new site)
• Feature request (request for a new functionality)
• Question
• Other

---

$ ./youtube-dl -v https://www.youtube.com/user/viperkeeper/videos
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', 'https://www.youtube.com/user/viperkeeper/videos']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2018.04.25
[debug] Python version 3.6.5 (CPython) - Linux-4.16.0-gentoo-pcireset-x86_64-AMD_Ryzen_Threadripper_1950X_16-Core_Processor-with-gentoo-2.4.1
[debug] exe versions: ffmpeg N-90883-g29fd44adf1, ffprobe N-90883-g29fd44adf1, rtmpdump 2.4
[debug] Proxy map: {}
[youtube:user] viperkeeper: Downloading channel page
[youtube:playlist] UUUtdmXEDHdSHPZP37n_Bymw: Downloading webpage
[download] Downloading playlist: Uploads from viperkeeper
[youtube:playlist] UUUtdmXEDHdSHPZP37n_Bymw: Downloading page #1
Traceback (most recent call last):
  File "/usr/lib64/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib64/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "./youtube-dl/__main__.py", line 19, in <module>
  File "./youtube-dl/youtube_dl/__init__.py", line 471, in main
  File "./youtube-dl/youtube_dl/__init__.py", line 461, in _real_main
  File "./youtube-dl/youtube_dl/YoutubeDL.py", line 1993, in download
  File "./youtube-dl/youtube_dl/YoutubeDL.py", line 800, in extract_info
  File "./youtube-dl/youtube_dl/YoutubeDL.py", line 861, in process_ie_result
  File "./youtube-dl/youtube_dl/YoutubeDL.py", line 800, in extract_info
  File "./youtube-dl/youtube_dl/YoutubeDL.py", line 960, in process_ie_result
  File "./youtube-dl/youtube_dl/extractor/youtube.py", line 278, in _entries
KeyError: 'content_html'

I’ve bisected the issue:

0fe7783eced5c62dbd95780c2150fd1080bd3927 is the first bad commit
commit 0fe7783eced5c62dbd95780c2150fd1080bd3927
Author: Sergey M․ <[e-mail]>
Date:   Sat Apr 28 01:59:15 2018 +0700

    [extractor/common] Add _download_json_handle

:040000 040000 0c314b881219767d3cfd1c5208417bd689839131 4bb685f1488b271d522d5c81a690aa1ebdbb8cb2 M	youtube_dl

The commit before that works fine.

[haasn]

Okay, after stumbling my way through some more god-awful python debugging, I managed to figure out the issue: The reason _download_webpage was randomly overriding keyword args was becaus the specific subclass of the class I’m looking at decided was interefering with things. More specifically, this diff fixes it:

diff --git a/youtube_dl/extractor/youtube.py b/youtube_dl/extractor/youtube.py
index e7bd1f18f..04aeb91af 100644
--- a/youtube_dl/extractor/youtube.py
+++ b/youtube_dl/extractor/youtube.py
@@ -246,9 +246,9 @@ class YoutubeBaseInfoExtractor(InfoExtractor):
 
         return True
 
-    def _download_webpage(self, *args, **kwargs):
+    def _download_webpage_handle(self, *args, **kwargs):
         kwargs.setdefault('query', {})['disable_polymer'] = 'true'
-        return super(YoutubeBaseInfoExtractor, self)._download_webpage(
+        return super(YoutubeBaseInfoExtractor, self)._download_webpage_handle(
             *args, **compat_kwargs(kwargs))
 
     def _real_initialize(self):

Shall I submit a pull request?

[Hrxn]

[…] - isn’t google still in the process of rolling out polymer?

Yes. They’re still changing things, e.g. the edit functionality of a playlist view on YouTube…