Convert from/to encodings with iconv-lite only

Take this example:

mystr = new Buffer("base64 string with ISO-8859-1 encoding goes here", "base64").toString();

buffer = new Buffer(buffer, "ISO-8859-1"); <--- this will fail as Buffer doesn't support that encoding

buffer = iconv.decode(buffer, "ISO-8859-1");
buffer = iconv.encode(buffer, "utf8").toString("utf8");

This code should be able to convert from a ISO-8859-1 (or any other encoding) string to UTF8, but it will fail because of the second line.

Can that be done using iconv-lite?

[ashtuchkin]

You’re inadvertently converting the chunk to string by doing buffer += chunk. You should keep it as a buffer, something like this:

        var buffer = new Buffer(0);
        stream.on("data", function(chunk) {
            buffer = Buffer.concat([buffer, chunk]);
        });

        stream.once("end", function(){
            str = iconv.decode(buffer, "ISO-8859-1");
        });

[ashtuchkin]

Yes, sure. iconv.decode(buf, encoding) takes binary data and decodes it into a JS string. So, what you’re need here is:

originalData = new Buffer("base64 string with ISO-8859-1 encoding goes here", "base64");  // Notice, no .toString().
jsStr = iconv.decode(originalData, "ISO-8859-1");

// Here you can use jsStr as usual javascript String:
jsStr.replace("hello", "world");

// If you need a buffer with this string UTF-8 encoded, then you can use Buffer like that:
utf8EncodedStringBuf = new Buffer(jsStr);  // utf8 is the default encoding.

// Or, equivalent
utf8EncodedStringBuf = iconv.encode(jsStr, "utf8");