CODEWITHSUNDEEP
pythonxmlweb-applicationsscreen-scrapingbeautifulsoup
muhuk
muhuk

Reputation: 16085

How to render contents of a tag in unicode in BeautifulSoup?

This is a soup from a WordPress post detail page:

content = soup.body.find('div', id=re.compile('post'))
title = content.h2.extract()
item['title'] = unicode(title.string)
item['content'] = u''.join(map(unicode, content.contents))

I want to omit the enclosing div tag when assigning item['content']. Is there any way to render all the child tags of a tag in unicode? Something like:

item['content'] = content.contents.__unicode__()

that will give me a single unicode string instead of a list.

Upvotes: 2

Views: 4175

Answers (1)

Ayman Hourieh
Ayman Hourieh

Reputation: 137176

Have you tried:

unicode(content)

It converts content's markup to a single Unicode string.

Edit: If you don't want the enclosing tag, try:

content.renderContents()

Upvotes: 6

Related Questions