question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Support new RTE Player

See original GitHub issue

Please follow the guide below

  • You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
  • Put an x into all the boxes [ ] relevant to your issue (like this: [x])
  • Use the Preview tab to see what your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2018.12.03. If it’s not, read this FAQ entry and update. Issues with outdated version will be rejected.

  • I’ve verified and I assure that I’m running youtube-dl 2018.12.03

Before submitting an issue make sure you have:

  • At least skimmed through the README, most notably the FAQ and BUGS sections
  • Searched the bugtracker for similar issues including closed ones
  • Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

  • Bug report (encountered problems with youtube-dl)
  • Site support request (request for adding support for a new site)
  • Feature request (request for a new functionality)
  • Question
  • Other

youtube-dl -v https://beta.rte.ie/player/series/whistleblower--the-maurice-mccabe-story/SI0000004409?epguid=IH000374544
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'https://beta.rte.ie/player/series/whistleblower--the-maurice-mccabe-story/SI0000004409?epguid=IH000374544']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2018.12.03
[debug] Python version 2.7.15rc1 (CPython) - Linux-4.15.0-42-generic-x86_64-with-LinuxMint-19-tara
[debug] exe versions: ffmpeg 3.4.4-0ubuntu0.18.04.1, ffprobe 3.4.4-0ubuntu0.18.04.1, rtmpdump 2.4
[debug] Proxy map: {}
[generic] SI0000004409?epguid=IH000374544: Requesting header
WARNING: Falling back on generic information extractor.
[generic] SI0000004409?epguid=IH000374544: Downloading webpage
[generic] SI0000004409?epguid=IH000374544: Extracting information
ERROR: Unsupported URL: https://beta.rte.ie/player/series/whistleblower--the-maurice-mccabe-story/SI0000004409?epguid=IH000374544
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/generic.py", line 2339, in _real_extract
    doc = compat_etree_fromstring(webpage.encode('utf-8'))
  File "/usr/local/bin/youtube-dl/youtube_dl/compat.py", line 2542, in compat_etree_fromstring
    doc = _XML(text, parser=etree.XMLParser(target=_TreeBuilder(element_factory=_element_factory)))
  File "/usr/local/bin/youtube-dl/youtube_dl/compat.py", line 2531, in _XML
    parser.feed(text)
  File "/usr/lib/python2.7/xml/etree/ElementTree.py", line 1659, in feed
    self._raiseerror(v)
  File "/usr/lib/python2.7/xml/etree/ElementTree.py", line 1523, in _raiseerror
    raise err
ParseError: syntax error: line 1, column 0
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 792, in extract_info
    ie_result = ie.extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 508, in extract
    ie_result = self._real_extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/generic.py", line 3318, in _real_extract
    raise UnsupportedError(url)
UnsupportedError: Unsupported URL: https://beta.rte.ie/player/series/whistleblower--the-maurice-mccabe-story/SI0000004409?epguid=IH000374544


...
<end of log>

Sample url: https://beta.rte.ie/player/series/whistleblower--the-maurice-mccabe-story/SI0000004409?epguid=IH000374544

Issue Analytics

  • State:closed
  • Created 5 years ago
  • Reactions:5
  • Comments:18 (2 by maintainers)

github_iconTop GitHub Comments

6reactions
macplaxtoncommented, Apr 23, 2019

I don’t know if this is of any help, but here goes…someone might be able to fill in the missing pieces between the player page URL and the actual video URL.

OS: openSUSE Leap 15.0 Browser: Version 73.0.3683.75 (openSUSE Build) (64-bit) youtube-dl --version 2019.04.17

Starting form here https://www.rte.ie/player/series/the-late-late-show/SI0000001694?epguid=IH000368289

I was able to watch the adverts, but then ran up against a DRM error of some sort. To solve that error, I installed a further package chromium-plugin-widevinecdm 1.49.1076-lp150.1.1 from the Packman repository. This enable me to watch the main programme in the browser.

Whilst playing the content in the browser, right-clicking and opening inspect element shows the browser console. From this I was able to pluck the correct video link:

Cross-Origin Read Blocking (CORB) blocked cross-origin response https://vod.rte.ie/rte/vod/RTE_Prod_-_Prod/406/504/IH000368289/2cdd5b50-6ef8-4e46-858a-a01e1baadd6b_f73e1a09-a085-40e8-ad42-1f0333e215e0-1555752767765.ism/.mpd?available=1555713840&expiry=1558305840&ip=xxx.xxx.xxx.xxx&token1=206c47ca9750935254bb44a00700fcd60ae86c0fc2d56741bad97a976a0a4eca&filter=systemBitrate<%3D7000000 with MIME type application/dash+xml. See https://www.chromestatus.com/feature/5629709824032768 for more details.

Note: ip=xxx.xxx.xxx.xxx Irish IP address redacted.

Copied link and trimmed down to the end of the IH number. https://vod.rte.ie/rte/vod/RTE_Prod_-_Prod/406/504/IH000368289/

Browsed this which has a selection of stream links. There is a massive .ismv stream link, but there is also a mp4 link with a [VID] tag. Copy this link and right-click and save. This link will download with youtube-dl, the page of links won’t, nor will the link of the programme main page.

Despite the size being marked 6.1M it was ~930MB, video plays fine in VLC.

5reactions
Vangelis66commented, Apr 24, 2019

It appears that if you possess a European Union (EU) IP address, you can still access streams 😉 . For https://www.rte.ie/player/series/the-late-late-show/SI0000001694 I didn’t even have to start watching (RTE Player was nagging me to disable uBlock Origin…).

Via Web Console (Basilisk web browser, a FirefoxESR 52 fork) I sniffed a lengthy “iframe” URI:

https://www.rte.ie/player/iframe/1.1.64/iframeEmbedSource-vjs.html?pid=https://link.eu.theplatform.com/s/1uC-gC/media/9dRvdSjq6SNM&signlanguage=off&mediatype=&playerprofile=391515:RTE_HTML5_Live&networkid=391515&serverurl=https://5f95b.v.fwmrm.net/&sitesectionid=RTE%20Player_Desktop_Web_NotRegistered&customid=fwVideoId&keyvaluesfield=fwKeyValues&mux_video_id=IH000368289&mux_video_title=Fri%2019%20April%202019&mux_video_series=The%20Late%20Late%20Show&mux_env_key=7rro99i9482rqqokaa3kuvgs4&mux_video_content_type=episode&mux_video_duration=6520.1&mux_video_stream_type=on-demand&mux_video_producer=No%20Provider&mux_player_version=1.1.64

They are in fact using the theplatform.com API to generate MPDs (mpeg-dash manifests, DRM’ed with common encryption, ergo WidevineCDM): https://link.eu.theplatform.com/s/1uC-gC/media/9dRvdSjq6SNM?formats=mpeg-dash&format=SMIL =>

<smil xmlns="http://www.w3.org/2005/SMIL21/Language">
<head>
	<meta name="title" content="The Late Late Show E15"/>
	<meta name="startingBitrate" content="2500000"/>
</head>
<body>
<seq>
	<ref src="https://ads.freewheel.tv" no-skip="true" tags="preroll">
	</ref>
<switch>
	<video src="https://vod.rte.ie/rte/vod/RTE_Prod_-_Prod/406/504/IH000368289/2cdd5b50-6ef8-4e46-858a-a01e1baadd6b_f73e1a09-a085-40e8-ad42-1f0333e215e0-1555752767765.ism/.mpd?available=1555713840&amp;expiry=1558305840&amp;ip=<snipped>&amp;token1=91d637deeeb62b0074d387a7cf8744eb17c372aa40c8417209df8fa10947bc0c&amp;filter=systemBitrate%3C%3D7000000" system-bitrate="0" height="1080" width="1920"/>
	<ref src="https://vod.rte.ie/rte/vod/RTE_Prod_-_Prod/406/504/IH000368289/2cdd5b50-6ef8-4e46-858a-a01e1baadd6b_f73e1a09-a085-40e8-ad42-1f0333e215e0-1555752767765.ism/.mpd?available=1555713840&amp;expiry=1558305840&amp;ip=<snipped>&amp;token1=91d637deeeb62b0074d387a7cf8744eb17c372aa40c8417209df8fa10947bc0c&amp;filter=systemBitrate%3C%3D7000000" title="1-1" dur="6524887ms" guid="IH000368289" type="application/dash+xml" height="1080" width="1920" clipBegin="0:00" clipEnd="25:54.985" security="commonEncryption">
		<param name="fwVideoId" value="IH000368289"/>
	</ref>
</switch>
	<ref src="https://ads.freewheel.tv" no-skip="true" tags="midroll">
	</ref>
<switch>
	<video src="https://vod.rte.ie/rte/vod/RTE_Prod_-_Prod/406/504/IH000368289/2cdd5b50-6ef8-4e46-858a-a01e1baadd6b_f73e1a09-a085-40e8-ad42-1f0333e215e0-1555752767765.ism/.mpd?available=1555713840&amp;expiry=1558305840&amp;ip=<snipped>&amp;token1=91d637deeeb62b0074d387a7cf8744eb17c372aa40c8417209df8fa10947bc0c&amp;filter=systemBitrate%3C%3D7000000" system-bitrate="0" height="1080" width="1920"/>
	<ref src="https://vod.rte.ie/rte/vod/RTE_Prod_-_Prod/406/504/IH000368289/2cdd5b50-6ef8-4e46-858a-a01e1baadd6b_f73e1a09-a085-40e8-ad42-1f0333e215e0-1555752767765.ism/.mpd?available=1555713840&amp;expiry=1558305840&amp;ip=<snipped>&amp;token1=91d637deeeb62b0074d387a7cf8744eb17c372aa40c8417209df8fa10947bc0c&amp;filter=systemBitrate%3C%3D7000000" title="The Late Late Show E15" dur="6524887ms" guid="IH000368289" type="application/dash+xml" height="1080" width="1920" clipBegin="25:54.985" security="commonEncryption">
		<param name="fwVideoId" value="IH000368289"/>
	</ref>
</switch>
	<ref src="https://ads.freewheel.tv" no-skip="true" tags="postroll">
	</ref>
</seq>
</body>
</smil>

From that SMIL file you can take the .mpd URI up until the .ism part and substitute the .ism extension with .mp4:

-https://vod.rte.ie/rte/vod/RTE_Prod_-_Prod/406/504/IH000368289/2cdd5b50-6ef8-4e46-858a-a01e1baadd6b_f73e1a09-a085-40e8-ad42-1f0333e215e0-1555752767765.ism
+https://vod.rte.ie/rte/vod/RTE_Prod_-_Prod/406/504/IH000368289/2cdd5b50-6ef8-4e46-858a-a01e1baadd6b_f73e1a09-a085-40e8-ad42-1f0333e215e0-1555752767765.mp4

… and there you have the direct HTTPS link to the video file… What @macplaxton has discovered is the unencrypted SOURCE video file at the root of the directory, which is being streamed via encrypted (cenc) MPEG-DASH format 🥇 …

Sadly, now that this is out in the open, I expect this loophole to be swiftly patched… Enjoy while you can 😜

Read more comments on GitHub >

github_iconTop Results From Across the Web

Help - RTÉ Player
If possible, please update the software on your TV to the latest version. We will be launching a new RTÉ Player service on...
Read more >
About RTÉ Player
RTÉ Player is a free online video service from Ireland's public service ... You can find a full list of supported devices in...
Read more >
Contact - Help - RTÉ Player
About RTÉ Player · Content on RTÉ · Frequently Asked Questions · My Location · My Account · Accessibility · Kids Mode ·...
Read more >
My Location - Help - RTÉ Player
If you are outside Ireland and want to watch live TV, you can go to the “Live” section. If you're in the Republic...
Read more >
Account - Help - RTÉ Player
Signing in to RTÉ Player allows you to: – Pick up where you left off across multiple devices – Receive personalised recommendations and...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found