CODEWITHSUNDEEP
javascriptnode.jshttps
Abhishek Tripathi
Abhishek Tripathi

Reputation: 1600

How to make a https request in node.js

I need to make a crawler. For http request i used to do this.

 var http=require('http');
 var options={
   host:'http://www.example.com',
   path:'/foo/example'
 };

 callback=function(response){
 var str='';
 response.on('data',function(chunk){
 str+=chunk;
 });
 response.on('end', function () {
       console.log(str);
 });
 }
 http.request(options, callback).end();

but I have to make a crawler for https://example.com/foo/example If I am using the same for https://example.com/foo/example it is giving this error

 events.js:72
    throw er; // Unhandled 'error' event
          ^
Error: getaddrinfo ENOTFOUND
at errnoException (dns.js:37:11)
at Object.onanswer [as oncomplete] (dns.js:124:16)

Upvotes: 1

Views: 3342

Answers (1)

Kevin Hutchinson
Kevin Hutchinson

Reputation: 2373

I'd recommend this excellent HTTP Request module: http://unirest.io/nodejs.html

You can install it with:

npm install -g unirest

Here's some example Node code with Unirest:

  var url = 'https://somewhere.com/';
  unirest.get(url)
    .end(function(response) {
      var body = response.body;
      // TODO: parse the body
      done();
    });

...so to get the HTML at www.purple.com you'd do this:

#!/usr/bin/env node

function getHTML(url, next) {
  var unirest = require('unirest');
  unirest.get(url)
    .end(function(response) {
      var body = response.body;
      if (next) next(body);
    });
}

getHTML('http://purple.com/', function(html) {
  console.log(html);
});

Upvotes: 3

Related Questions