CODEWITHSUNDEEP
phpdomcurlcharacter-encoding
Maharshi Raval
Maharshi Raval

Reputation: 278

CURL Error in Encoding the Characters

I am trying to Fetch Some data from a Web Page. But the issue is instead of Pulling say :

64 × 191 × 75 cm

it displays on echo as 

64 × 191 × 75 cm

My code:

<?php

$url = "http://www.google.co.uk"
$ch = curl_init();
curl_setopt($ch, CURLOPT_URL, $url);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
curl_setopt($ch, CURLOPT_USERAGENT, "Mozilla/5.0 (compatible; Googlebot/2.1;      +http://www.google.com/bot.html)");
curl_setopt($ch, CURLOPT_ENCODING ,"");

$html = curl_exec($ch);
$dom = new DOMDocument();
@$dom->loadHTML($html);
$xpath = new DOMXPath($dom);
$q_Dimensions = "//tr/td[@class='FieldTitle'][contains(.,'Dimensions of packed product (W×H×D):')]/following-sibling::td/text()";
$dimentionsQ = $xpath->query($q_Dimensions);
$dimentions = $dimentionsQ->item(0)->nodeValue;
echo $dimentions;
exit();

I believe this could be some sort of issue with the Character Encoding but not able to go any further. Any help is much appreciated.

Upvotes: 1

Views: 1138

Answers (2)

Kevin
Kevin

Reputation: 41885

Alternatively, setting the charset to UTF-8 in header() works fine also:

// add this on the top of your php script
header('Content-Type: text/html; charset=utf-8');

$url = "google.co.uk";
$ch = curl_init();
curl_setopt($ch, CURLOPT_URL, $url);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
curl_setopt($ch, CURLOPT_USERAGENT, "Mozilla/5.0 (compatible; Googlebot/2.1;      +http://www.google.com/bot.html)");
curl_setopt($ch, CURLOPT_ENCODING ,"");

$html = curl_exec($ch);
$dom = new DOMDocument();
@$dom->loadHTML($html);
$xpath = new DOMXPath($dom);
$q_Dimensions = "//tr/td[@class='FieldTitle'][contains(.,'Dimensions of packed product (W×H×D):')]/following-sibling::td/text()";
$dimentionsQ = $xpath->query($q_Dimensions);
$dimentions = $dimentionsQ->item(0)->nodeValue;
echo $dimentions; // 64 × 191 × 75 cm
exit();

Upvotes: 0

Anri
Anri

Reputation: 1693

set another curl option for CURLOPT_ENCODING and set it to "" to ensure it will not return any garbage

   curl_setopt($ch, CURLOPT_ENCODING ,"");

Upvotes: 1

Related Questions