CODEWITHSUNDEEP
c#html-agility-pack
meirlo
meirlo

Reputation: 211

Prevent HTMLAgilityPack from connecting words when using InnerText

I'm trying to do a simple task of getting text from HTML document. So I'm using HTMLdoc.DocumentNode.InnerText for that. The problem is that on some sites the don't put spaces between words when they are in a different tags. In those cases the DocumentNode.InnerText connect those word into one and it became useless.

for example, I'm trying to read a site contain that line

<span>İstanbul</span><ul><li><a href="i1.htm">Adana</a></li>

I'm getting "İstanbulAdana" which is meaningless.

I couldn't find any solution at HTMLAgilityPack documentation nor Google

Do I missing something?

Thanks,

Upvotes: 6

Views: 1809

Answers (2)

tornord
tornord

Reputation: 345

Well, the code snippet hangs for this example: 

const string html = @"<td><font size=""2"">abc </font><font size=""2"">(</font><font size=""2"">abc</font><font size=""2"">) </font><a href=""?query=abc"">abc</a>, abc<br><font size=""2"">abc </font>abc, <a href=""?query=abc"">abc</a>, abc, <a href=""?query=abc"">abc</a><br><font size=""2"">abc </font>abc abc, abc abc<br></td>";

It doesn't hang without the join-clause (but it doesn't put spaces correctly neither).

Upvotes: 0

shriek
shriek

Reputation: 5197

That should be rather easy to do.

const string html = @"<span>İstanbul</span><ul><li><a href=""i1.htm"">Adana</a></li>";
var doc = new HtmlDocument();
doc.LoadHtml(html);
string result = string.Join(" ", doc.DocumentNode.Descendants()
  .Where(n => !n.HasChildNodes && !string.IsNullOrWhiteSpace(n.InnerText))
  .Select(n => n.InnerText));
Console.WriteLine(result); // prints "İstanbul Adana"

Upvotes: 12

Related Questions