Sometimes a HTML page is served back ; Specify user agent?

Hi ;

This library is wonderful, and works like a charm. But sometimes, the data returned by the server is a HTML page, when the same feed is actually viewable in a browser, for example this one:

http://www.jesusandmo.net/comic/feed/

Or this one :

https://www.blendernation.com/feed/

So I was wondering if there was some way to control the user agent to test if I can get the feed anyway… Maybe on the request side?

[rbren]

I would suggest setting the Accept header to tell it what content-type you want back. Probably application/rss+xml or text/xml

It probably makes sense for the parser to pass this header automatically as well.

[rbren]

Currently there’s no way to add headers to the HTTP request, but if you want to send a PR, I’d be happy to take a look. We set the user agent to ‘rss-parser’ right now.

Otherwise, I’d recommend doing the HTTP request yourself, and just using parseString instead of parseURL.