--no-abort-on-error and --ignore-errors don't work as documented
See original GitHub issueDO NOT REMOVE OR SKIP THE ISSUE TEMPLATE
- I understand that I will be blocked if I remove or skip any mandatory* field
Checklist
- I’m reporting a bug unrelated to a specific site
- I’ve verified that I’m running yt-dlp version 2022.09.01 (update instructions) or later (specify commit)
- I’ve checked that all provided URLs are playable in a browser with the same IP and same login details
- I’ve checked that all URLs and arguments with special characters are properly quoted or escaped
- I’ve searched the bugtracker for similar issues including closed ones. DO NOT post duplicates
- I’ve read the guidelines for opening an issue
Provide a description that is worded well enough to be understood
Summary
The order of --ignore-errors
and --no-abort-on-error
is crucially important, but this is a gotcha based upon the documentation.
Weirdly, --abort-on-error
== --no-ignore-errors
, but --ignore-errors
!= --no-abort-on-error
.
--no-abort-on-error
is undocumented in the README.
This is important if one subtitle is missing, it can cause an abort. As opposed to if the thumbnail is missing, and then you just get a warning.
Details
The following options are poorly documented, inconsistent, and can lead to footguns.
From the README:
-i, --ignore-errors Continue on download errors, for
example to skip unavailable videos in a
playlist
--abort-on-error Abort downloading of further videos (in
the playlist or the command line) if an
error occurs
However, from the code:
general.add_option(
'-i', '--ignore-errors',
action='store_true', dest='ignoreerrors',
help='Ignore download and postprocessing errors. The download will be considered successful even if the postprocessing fails')
general.add_option(
'--no-abort-on-error',
action='store_const', dest='ignoreerrors', const='only_download',
help='Continue with next video on download errors; e.g. to skip unavailable videos in a playlist (default)')
general.add_option(
'--abort-on-error', '--no-ignore-errors',
action='store_false', dest='ignoreerrors',
help='Abort downloading of further videos if an error occurs (Alias: --no-ignore-errors)')
So, basically the behavior is:
--ignore-errors
=>ignoreerrors = True
--no-ignore-errors
=>ignoreerrors = False
--abort-on-error
=>ignoreerrors = False
--no-abort-on-error
=>ignoreerrors = only_download
This is such a footgun because:
- Why is ‘ignoreerrors’ overloaded to have a ternary value?
- Why aren’t
--abort-on-error
and--no-abort-on-error
opposites? - The order in which you specify the arguments is important
and MOST CRUCIALLY, --no-abort-on-error
would lead you to believe that if everything downloads correctly except a single subtitle file, that you should be fine. But instead the whole process aborts.
This has confused other people, but is not the same except bug report: https://github.com/yt-dlp/yt-dlp/issues/3691 https://github.com/yt-dlp/yt-dlp/issues/2875
Suggested remediation
Cheesy Mode
One missing subtitle should be a warning, just like a missing thumbnail is a warning.
Easy Mode
Rewrite the documentation:
- Add documentation for
--no-abort-on-error
- Explain that the order of
--ignore-errors
and--no-abort-on-error
matters. - If
--no-abort-on-error
comes after--ignore-errors
, then an error in one download will abort that individual download. So--ignore-errors
should come afterwards if you always want to finish downloading and preprocessing when possible.
Hero Mode
Don’t use ignoreerrors
for both playlist and individual video errors.
Rewrite so the following much less confusing options are present, with appropriate semantics in the code. They have the nice benefit that the order doesn’t matter.
general.add_option(
'-i', '--ignore-video-errors',
action='store_true', dest='ignorevideoerrors',
help='Ignore individual download and postprocessing errors. The download will be considered successful even if the postprocessing fails')
general.add_option(
'--no-ignore-video-errors',
action='store_false', dest='ignorevideoerrors',
help='Abort this individual download if an error occurs')
general.add_option(
'--errors-continue-on-next-video',
action='store_true', dest='continueonnextvideo',
help='Continue with next video on download errors; e.g. to skip unavailable videos in a playlist (default)')
general.add_option(
'--errors-dont-continue-on-next-video',
action='store_false', dest='continueonnextvideo',
help='Don't continue with next video on download errors')
Examples
Here are the commands I will demonstrate:
# thumbnail missing, I get a warning
yt-dlp -vU --write-thumbnail --ignore-errors --no-abort-on-error 'http://www.youtube.com/watch?v=N-NoPwYL9lc'
# some autogenerated sub for und-en missing, I get a crash
yt-dlp -vU --write-auto-subs --sub-langs all --ignore-errors --no-abort-on-error 'http://www.youtube.com/watch?v=N-NoPwYL9lc'
# some autogenerated sub for und-en missing, I get a warning
yt-dlp -vU --write-auto-subs --sub-langs all --no-abort-on-error --ignore-errors 'http://www.youtube.com/watch?v=N-NoPwYL9lc'
Because I can’t paste more than 65536 characters, I will first demonstrate the command the crashes (second one above) and snip some of the highly repetitive lines downloading some of the 100 different auto subtitles.
Provide verbose output that clearly demonstrates the problem
- Run your yt-dlp command with -vU flag added (
yt-dlp -vU <your command line>
) - Copy the WHOLE output (starting with
[debug] Command-line config
) and insert it below
Complete Verbose Output
[debug] Command-line config: ['-vU', '--write-auto-subs', '--sub-langs', 'all', '--ignore-errors', '--no-abort-on-error', 'http://www.youtube.com/watch?v=N-NoPwYL9lc']
[debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out UTF-8 (No ANSI), error UTF-8 (No ANSI), screen UTF-8 (No ANSI)
[debug] yt-dlp version 2022.09.01 [5d7c7d6] (pip)
[debug] Python 3.7.10 (CPython 64bit) - Linux-5.10.135-122.509.amzn2.x86_64-x86_64-with-glibc2.2.5 (glibc 2.2.5)
[debug] Checking exe version: ffmpeg -bsfs
[debug] Checking exe version: ffprobe -bsfs
[debug] exe versions: none
[debug] Optional libraries: Cryptodome-3.15.0, brotli-1.0.9, certifi-2022.06.15, mutagen-1.45.1, sqlite3-2.6.0, websockets-10.3
[debug] Proxy map: {}
[debug] Loaded 1670 extractors
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp/releases/latest
Latest version: 2022.09.01, Current version: 2022.09.01
yt-dlp is up to date (2022.09.01)
[debug] [youtube] Extracting URL: http://www.youtube.com/watch?v=N-NoPwYL9lc
[youtube] N-NoPwYL9lc: Downloading webpage
[youtube] N-NoPwYL9lc: Downloading android player API JSON
[debug] Sort order given by extractor: quality, res, fps, hdr:12, source, vcodec:vp9.2, channels, acodec, lang, proto
[debug] Formats sorted by: hasvid, ie_pref, quality, res, fps, hdr:12(7), source, vcodec:vp9.2(10), channels, acodec, lang, proto, filesize, fs_approx, tbr, vbr, abr, asr, vext, aext, hasaud, id
[info] N-NoPwYL9lc: Downloading subtitles: af-en, ak-en, sq-en, am-en, ar-en, hy-en, as-en, ay-en, az-en, bn-en, eu-en, be-en, bho-en, bs-en, bg-en, my-en, ca-en, ceb-en, zh-Hans-en, zh-Hant-en, co-en, hr-en, cs-en, da-en, dv-en, nl-en, en-en, eo-en, et-en, ee-en, fil-en, fi-en, fr-en, gl-en, lg-en, ka-en, de-en, el-en, gn-en, gu-en, ht-en, ha-en, haw-en, iw-en, hi-en, hmn-en, hu-en, is-en, ig-en, id-en, ga-en, it-en, ja-en, jv-en, kn-en, kk-en, km-en, rw-en, ko-en, kri-en, ku-en, ky-en, lo-en, la-en, lv-en, ln-en, lt-en, lb-en, mk-en, mg-en, ms-en, ml-en, mt-en, mi-en, mr-en, mn-en, ne-en, nso-en, no-en, ny-en, or-en, om-en, ps-en, fa-en, pl-en, pt-en, pa-en, qu-en, ro-en, ru-en, sm-en, sa-en, gd-en, sr-en, sn-en, sd-en, si-en, sk-en, sl-en, so-en, st-en, es-en, su-en, sw-en, sv-en, tg-en, ta-en, tt-en, te-en, th-en, ti-en, ts-en, tr-en, tk-en, uk-en, und-en, ur-en, ug-en, uz-en, vi-en, cy-en, fy-en, xh-en, yi-en, yo-en, zu-en, af, ak, sq, am, ar, hy, as, ay, az, bn, eu, be, bho, bs, bg, my, ca, ceb, zh-Hans, zh-Hant, co, hr, cs, da, dv, nl, en-orig, en, eo, et, ee, fil, fi, fr, gl, lg, ka, de, el, gn, gu, ht, ha, haw, iw, hi, hmn, hu, is, ig, id, ga, it, ja, jv, kn, kk, km, rw, ko, kri, ku, ky, lo, la, lv, ln, lt, lb, mk, mg, ms, ml, mt, mi, mr, mn, ne, nso, no, ny, or, om, ps, fa, pl, pt, pa, qu, ro, ru, sm, sa, gd, sr, sn, sd, si, sk, sl, so, st, es, su, sw, sv, tg, ta, tt, te, th, ti, ts, tr, tk, uk, und, ur, ug, uz, vi, cy, fy, xh, yi, yo, zu
[debug] Default format spec: best/bestvideo+bestaudio
[info] N-NoPwYL9lc: Downloading 1 format(s): 22
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].af-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=af-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].af-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 8.08KiB at Unknown B/s (00:00)
[download] 100% of 8.08KiB in 00:00 at 40.02KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].ak-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=ak-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].ak-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 8.50KiB at Unknown B/s (00:00)
[download] 100% of 8.50KiB in 00:00 at 52.48KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].sq-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=sq-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].sq-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 9.02KiB at Unknown B/s (00:00)
[download] 100% of 9.02KiB in 00:00 at 41.66KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].am-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=am-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].am-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 11.17KiB at Unknown B/s (00:00)
[download] 100% of 11.17KiB in 00:00 at 66.75KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].ar-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=ar-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].ar-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 10.49KiB at Unknown B/s (00:00)
[download] 100% of 10.49KiB in 00:00 at 61.29KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].hy-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=hy-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].hy-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 12.84KiB at Unknown B/s (00:00)
[download] 100% of 12.84KiB in 00:00 at 76.00KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].as-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=as-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].as-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 15.00KiB at Unknown B/s (00:00)
[download] 15.70KiB at 13.58MiB/s (00:00)
[download] 100% of 15.70KiB in 00:00 at 93.09KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].ay-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=ay-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].ay-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 9.01KiB at Unknown B/s (00:00)
[download] 100% of 9.01KiB in 00:00 at 55.07KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].az-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=az-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].az-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 8.61KiB at Unknown B/s (00:00)
[download] 100% of 8.61KiB in 00:00 at 49.73KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].bn-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=bn-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].bn-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 15.00KiB at Unknown B/s (00:00)
[download] 15.87KiB at 13.65MiB/s (00:00)
[download] 100% of 15.87KiB in 00:00 at 95.42KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].eu-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=eu-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].eu-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 8.01KiB at Unknown B/s (00:00)
[download] 100% of 8.01KiB in 00:00 at 47.74KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].be-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=be-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].be-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 12.03KiB at Unknown B/s (00:00)
[download] 100% of 12.03KiB in 00:00 at 48.50KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].bho-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=bho-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].bho-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 15.00KiB at Unknown B/s (00:00)
[download] 15.63KiB at 13.89MiB/s (00:00)
[download] 100% of 15.63KiB in 00:00 at 91.50KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].bs-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=bs-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].bs-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 7.90KiB at Unknown B/s (00:00)
[download] 100% of 7.90KiB in 00:00 at 49.01KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].bg-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=bg-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].bg-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 12.02KiB at Unknown B/s (00:00)
[download] 100% of 12.02KiB in 00:00 at 64.09KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].my-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=my-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].my-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 15.00KiB at Unknown B/s (00:00)
[download] 18.34KiB at 15.05MiB/s (00:00)
[download] 100% of 18.34KiB in 00:00 at 104.66KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].ca-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=ca-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].ca-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 8.26KiB at Unknown B/s (00:00)
[download] 100% of 8.26KiB in 00:00 at 49.84KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].ceb-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=ceb-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].ceb-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 8.93KiB at 8.47MiB/s (00:00)
[download] 100% of 8.93KiB in 00:00 at 54.48KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].zh-Hans-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=zh-Hans-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].zh-Hans-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 7.66KiB at Unknown B/s (00:00)
[download] 100% of 7.66KiB in 00:00 at 47.02KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].zh-Hant-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=zh-Hant-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].zh-Hant-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 7.66KiB at Unknown B/s (00:00)
[download] 100% of 7.66KiB in 00:00 at 39.11KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].co-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=co-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].co-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 8.41KiB at Unknown B/s (00:00)
[download] 100% of 8.41KiB in 00:00 at 49.17KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].hr-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=hr-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].hr-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 7.95KiB at Unknown B/s (00:00)
[download] 100% of 7.95KiB in 00:00 at 41.16KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].cs-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=cs-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].cs-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 8.07KiB at Unknown B/s (00:00)
[download] 100% of 8.07KiB in 00:00 at 50.81KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].da-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=da-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].da-en.vtt
...
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 7.73KiB at Unknown B/s (00:00)
[download] 100% of 7.73KiB in 00:00 at 41.82KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].uk-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=uk-en&fmt=vtt"
[download] Destination: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].uk-en.vtt
[download] 1.00KiB at Unknown B/s (00:00)
[download] 3.00KiB at Unknown B/s (00:00)
[download] 7.00KiB at Unknown B/s (00:00)
[download] 11.74KiB at 11.35MiB/s (00:00)
[download] 100% of 11.74KiB in 00:00 at 61.25KiB/s
[info] Writing video subtitles to: Black Hat Data Science - Joseph Turian at Data Gotham (O'Reilly Strata) 2012 [N-NoPwYL9lc].und-en.vtt
[debug] Invoking http downloader on "https://www.youtube.com/api/timedtext?v=N-NoPwYL9lc&caps=asr&xoaf=5&hl=en&ip=0.0.0.0&ipbits=0&expire=1663153000&sparams=ip%2Cipbits%2Cexpire%2Cv%2Ccaps%2Cxoaf&signature=421CD46F2E8313EDD360A5F70BD87477EFE6BF5E.93B218481ECE0FB95E49775109F13C4CB3B21E51&key=yt8&lang=en&tlang=und-en&fmt=vtt"
ERROR: Unable to download video subtitles for 'und-en': HTTP Error 404: Not Found
Traceback (most recent call last):
File "/home/turian/.local/lib/python3.7/site-packages/yt_dlp/YoutubeDL.py", line 3907, in _write_subtitles
self.dl(sub_filename, sub_copy, subtitle=True)
File "/home/turian/.local/lib/python3.7/site-packages/yt_dlp/YoutubeDL.py", line 2895, in dl
return fd.download(name, new_info, subtitle)
File "/home/turian/.local/lib/python3.7/site-packages/yt_dlp/downloader/common.py", line 443, in download
ret = self.real_download(filename, info_dict)
File "/home/turian/.local/lib/python3.7/site-packages/yt_dlp/downloader/http.py", line 371, in real_download
establish_connection()
File "/home/turian/.local/lib/python3.7/site-packages/yt_dlp/downloader/http.py", line 129, in establish_connection
ctx.data = self.ydl.urlopen(request)
File "/home/turian/.local/lib/python3.7/site-packages/yt_dlp/YoutubeDL.py", line 3656, in urlopen
return self._opener.open(req, timeout=self._socket_timeout)
File "/usr/lib64/python3.7/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib64/python3.7/urllib/request.py", line 641, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib64/python3.7/urllib/request.py", line 569, in error
return self._call_chain(*args)
File "/usr/lib64/python3.7/urllib/request.py", line 503, in _call_chain
result = func(*args)
File "/usr/lib64/python3.7/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/turian/.local/lib/python3.7/site-packages/yt_dlp/YoutubeDL.py", line 1459, in wrapper
return func(self, *args, **kwargs)
File "/home/turian/.local/lib/python3.7/site-packages/yt_dlp/YoutubeDL.py", line 1556, in __extract_info
return self.process_ie_result(ie_result, download, extra_info)
File "/home/turian/.local/lib/python3.7/site-packages/yt_dlp/YoutubeDL.py", line 1614, in process_ie_result
ie_result = self.process_video_result(ie_result, download=download)
File "/home/turian/.local/lib/python3.7/site-packages/yt_dlp/YoutubeDL.py", line 2712, in process_video_result
self.process_info(new_info)
File "/home/turian/.local/lib/python3.7/site-packages/yt_dlp/YoutubeDL.py", line 2954, in process_info
sub_files = self._write_subtitles(info_dict, temp_filename)
File "/home/turian/.local/lib/python3.7/site-packages/yt_dlp/YoutubeDL.py", line 3915, in _write_subtitles
raise DownloadError(msg)
yt_dlp.utils.DownloadError: Unable to download video subtitles for 'und-en': HTTP Error 404: Not Found
Issue Analytics
- State:
- Created a year ago
- Reactions:1
- Comments:10 (3 by maintainers)
Thank you for the tip! Yeah, I’m trying to upstream yt-dlp into ArchiveBox to replace youtube-dl, so archival is the goal.
But isn’t
--extractor-args youtube:skip=translated_subs
the same as “–write-subs --sub-langs all” ? If not what is the difference?This sounds like an extractor bug. I will look into it
Btw, not really related to this; if your intention of downloading all subs is archiving, I would recommend using
--extractor-args youtube:skip=translated_subs
. I imagine you don’t really want to archive all auto-translated subs