Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Big memory consumption spike

See original GitHub issue

Checklist

I’m reporting a bug unrelated to a specific site
I’ve verified that I’m running yt-dlp version 2022.01.21. (update instructions)
I’ve checked that all provided URLs are alive and playable in a browser
I’ve checked that all URLs and arguments with special characters are properly quoted or escaped
I’ve searched the bugtracker for similar issues including closed ones. DO NOT post duplicates
I’ve read the guidelines for opening an issue

Description

Calling extract_info with url https://redd.it/sdl0bi in parameters will cause big memory consumption spike, up to 400 MB for me. For other links all work as intended.

Verbose log

yt-dlp -vU 'https://redd.it/sdl0bi'
[debug] Command-line config: ['-vU', 'https://redd.it/sdl0bi']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, err utf-8, pref UTF-8
[debug] yt-dlp version 2022.01.21 [f20d607b0]
[debug] Python version 3.9.9 (CPython 64bit) - macOS-10.15.7-x86_64-i386-64bit
[debug] exe versions: ffmpeg 4.4.1 (setts), ffprobe 4.4.1, rtmpdump 2.4
[debug] Optional libraries: Cryptodome, mutagen, sqlite, websockets
[debug] Proxy map: {}
Latest version: 2022.01.21, Current version: 2022.01.21
yt-dlp is up to date (2022.01.21)
[debug] [generic] Extracting URL: https://redd.it/sdl0bi
[generic] sdl0bi: Requesting header
[redirect] Following redirect to https://www.reddit.com/comments/sdl0bi
[debug] [generic] Extracting URL: https://www.reddit.com/comments/sdl0bi
[generic] sdl0bi: Requesting header
WARNING: [generic] Falling back on generic information extractor.
[generic] sdl0bi: Downloading webpage
[generic] sdl0bi: Extracting information
[debug] Looking for video embeds
ERROR: Unsupported URL: https://www.reddit.com/comments/sdl0bi
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/yt_dlp/YoutubeDL.py", line 1367, in wrapper
    return func(self, *args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/yt_dlp/YoutubeDL.py", line 1437, in __extract_info
    ie_result = ie.extract(url)
  File "/usr/local/lib/python3.9/site-packages/yt_dlp/extractor/common.py", line 612, in extract
    ie_result = self._real_extract(url)
  File "/usr/local/lib/python3.9/site-packages/yt_dlp/extractor/generic.py", line 3966, in _real_extract
    raise UnsupportedError(url)
yt_dlp.utils.UnsupportedError: Unsupported URL: https://www.reddit.com/comments/sdl0bi