CODEWITHSUNDEEP
phpcurlweb-scraping
flyingarmadillo
flyingarmadillo

Reputation: 2139

cURL Page and Navigate DOM

I am simply trying to retrieve a pages' title with the script below. However, I am doing something wrong because I keep getting this error:

PHP Fatal error:  Call to a member function getElementsByTagName() on a non-object in /Users/robertquinn/Desktop/SCRAPE/asu.php on line 22

This is my first time using curl functions so please let me know if I am horribly screwing something up here. is getElementsByTagName() soley an XML DOM method?

<?php  

    function get_data($url) {

        $userAgent = 'Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.2) Gecko/20090729 Firefox/3.5.2 GTB5';
        $ch = curl_init();
        curl_setopt($ch,CURLOPT_COOKIE,"someCookie=2127;onlineSelection=C");
        curl_setopt ($ch, CURLOPT_COOKIEFILE, 'cookie.txt');
        curl_setopt($ch, CURLOPT_COOKIEJAR, 'cookie.txt');
        curl_setopt($ch, CURLOPT_USERAGENT, $userAgent);
        curl_setopt($ch, CURLOPT_URL, $url);
        curl_setopt($ch, CURLOPT_FAILONERROR, true);
        curl_setopt($ch, CURLOPT_FOLLOWLOCATION, true);
        curl_setopt($ch, CURLOPT_AUTOREFERER, true);
        curl_setopt($ch, CURLOPT_RETURNTRANSFER,true);
        curl_setopt($ch, CURLOPT_TIMEOUT, 100);
        $html = curl_exec($ch);
        curl_close($ch);

        $doc = new DOMDocument();
        $body = $doc->loadHTML( $html );
        $title_value = $body->getElementsByTagName('title')->nodeValue;

        echo $title_value;
    }

    get_data('http://www.someurl.com');

    ?>

Upvotes: 0

Views: 1615

Answers (2)

r-sal
r-sal

Reputation: 1169

I like using simple_html_dom is really simple, for example I would just do

...
$page = curl_exec($ch);

$html = str_get_html($page);
echo $html->find('title', 0)->plaintext;

Upvotes: 0

Lawrence Cherone
Lawrence Cherone

Reputation: 46620

Change you DOMDocument part too:

 $doc = new DOMDocument();
 $doc->loadHTML( $html );
 //Suppress strict errors or you could just suppress errors directly e.g: @$doc->loadHTML( $html );
 $doc->strictErrorChecking = false;

 $title_value = $doc->getElementsByTagName('title')->item(0)->nodeValue;

Upvotes: 3

Related Questions