CODEWITHSUNDEEP
phpdomdocument
Coleman
Coleman

Reputation: 670

How to prevent DOMDocument from converting   to unicode

I am trying to get the inner HTML of a DOMElement in PHP. Example markup:

<div>...</div>
<div id="target"><p>Here's some &nbsp; <em>funny</em> &nbsp; text</p></div>
<div>...</div>
<div>...</div>

Feeding the above string into the variable $html, I am doing:

$doc = new DOMDocument();
@$doc->loadHTML("<html><body>$html</body></html>");
$node = $doc->getElementById('target')
$markup = '';
foreach ($node->childNodes as $child) {
  $markup .= $child->ownerDocument->saveXML($child);
}

The resulting $markup string looks like this (converted to JSON to reveal the invisible characters):

"<p>Here's some \u00a0 <em>funny<\/em> \u00a0 text<\/p>"

All &nbsp; characters have been converted to Unicode non-breaking spaces, which breaks my application.

In my ideal world, there would be a way to retrieve the original string of HTML inside the target div as-is, without DomDocument doing anything to it at all. That doesn't seem to be possible, so the next best thing would be to somehow turn off this character conversion. So far I've tried:

Finally I resorted to tacking on this hack, which works but doesn't feel like the right solution.

$markup = str_replace("\xc2\xa0", '&nbsp;', $markup);

Surely there is a better way?

Upvotes: 5

Views: 1643

Answers (2)

miken32
miken32

Reputation: 42701

You can use the very cryptic function mb_encode_numericentity() to convert those characters outside of the visible ASCII range, so it won't touch your markup and such:

<?php
$html = <<< HTML
<div>...</div>
<div id="target"><p>Here's some &nbsp; <em>funny 😂</em> &nbsp; text</p></div>
<div>...</div>
<div>...</div>
HTML;

$doc = new DOMDocument();
libxml_use_internal_errors();
$doc->loadHTML("<html><head><meta charset=UTF-8></head><body>$html</body></html>");
$node = $doc->getElementById('target');
$markup = '';
foreach ($node->childNodes as $child) {
  $markup .= $child->ownerDocument->saveHTML($child);
}

$convmap = [
    0x00, 0x1f, 0, 0xff,
    0x7f, 0x10ffff, 0, 0xffffff,
];

$markup = mb_encode_numericentity($markup, $convmap, "UTF-8");

echo $markup;

Output:

<p>Here's some &#160; <em>funny &#128514;</em> &#160; text</p>

Outside of the scope of the original question, but I've added an emoji to the string as well. To encode multibyte characters, <meta charset="UTF-8"> will force PHP to treat the content as Unicode instead of its default ISO-8859-1.

Upvotes: 7

NicoHood
NicoHood

Reputation: 1093

I also ran into this issue, it is basically described here already.

The solutions provided worked for me, but only the &nbsp; character failed, so I came here. The provided solution by miken32 did not work for me, at least not when saving, but rather when loading the html. The solution is:

$dom = new DOMDocument();
$dom->loadHTML(mb_convert_encoding($content, 'HTML-ENTITIES', 'UTF-8'));

This solution is also described in the linked stackoverflow issue and this blog post that helped me solving the issue.

Upvotes: 0

Related Questions