CODEWITHSUNDEEP
htmlnode.jshttpencodingutf-8
Ben Diamant
Ben Diamant

Reputation: 6206

Get UTF-8 html content with Node's http.get

I'm trying to pull the html content of a given url and the origin content encoding is utf-8. I get the html of the page but the text whitin the html elemnts are returned in bad format (question marks).

This is what I do:

var parsedPath = url.parse(path);
var options = {
    host: parsedPath.host,
    path: parsedPath.path,
    headers: {
        'Accept-Charset' : 'utf-8',
    }
}

http.get(options, function (res) {
    var data = "";
    res.on('data', function (chunk) {
        data += chunk;
    });
    res.on("end", function () {
        console.log(data);
    });
}).on("error", function () {
    callback(null);
});

How can I enforce the encoding of the returned data?

Thanks

Upvotes: 7

Views: 10906

Answers (1)

alexpods
alexpods

Reputation: 48505

Use the setEncoding() method like this:

http.get(options, function (res) {
    res.setEncoding('utf8');

    var data = "";
    res.on('data', function (chunk) {
        data += chunk;
    });
    res.on("end", function () {
        console.log(data);
    });
});

Upvotes: 14

Related Questions