Invalid decoded text

• Platform: Mac
• Mercury Parser Version: 2.1.0
• Node Version (if a Node bug): 10
• Browser Version (if a browser bug):

Expected Behavior

Parsed HTML should be properly encoded as per the original text

Current Behavior

The parsed html contains in invalid text .Might be because of decoding issue.

Steps to Reproduce

• Fetch the html using any client
• Pass that to the parse using Mercury.parse(url,{html:fetchedHtml})
• Returned HTML contains incorrectly decoded text

Some Links: https://www.newyorker.com/culture/the-new-yorker-interview/daenerys-tells-all-game-of-thrones-finale-emilia-clarke-beyonce

Detailed Description

I want to parse by fetching the html and giving to the parse instead of parser fetching the html.

Possible Solution

After looking at the code, it seem you are handling the case for browser only i.e. only if the html is provided from the browser, the proper encoding is checked from the html file. Ideally it should be able to decode the text irrespective of whether the parser is running on a browser or not

[FarmaanElahi]

For me problem was when I was trying to pass the local html as string. Using Buffer fixed the issue

Mercury.parse(url, {
        html: Buffer.from(html, "utf-8"),
        headers: {
            "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) " +
                "Chrome/60.0.3112.113 Safari/537.36"
        },
    })

[farmaan-appachhi]

Fixed it by passing the html as Buffer with utf-8 instead of string as mentioned in the README