CODEWITHSUNDEEP
pythonxmlxsdlxml
Seán Hayes
Seán Hayes

Reputation: 4360

How do I validate against multiple xsd schemas using lxml?

I'm writing a unit test that validates sitemap xml I generate by fetching its xsd schema and validating using python's lxml library:

Here's some metadata on my root element:

xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
xmlns:image="http://www.google.com/schemas/sitemap-image/1.1"
xsi:schemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9 
http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd 
http://www.google.com/schemas/sitemap-image/1.1 
http://www.google.com/schemas/sitemap-image/1.1/sitemap-image.xsd"

And this test code:

_xsd_validators = {}
def get_xsd_validator(url):
    if url not in _xsd_validators:
        _xsd_validators[url] = etree.XMLSchema(etree.parse(StringIO(requests.get(url).content)))
    return _xsd_validators[url]


# this util function is later on in a TestCase
def validate_xml(self, content):
    content.seek(0)
    doc = etree.parse(content)
    schema_loc = doc.getroot().attrib.get('{http://www.w3.org/2001/XMLSchema-instance}schemaLocation').split(' ')
    # lxml doesn't like multiple namespaces
    for i, loc in enumerate(schema_loc):
        if i % 2 == 1:
            get_xsd_validator(schema_loc[i]).assertValid(doc)
    return doc

Example XML that fails validation:

<?xml version="1.0" encoding="UTF-8"?>
<urlset
  xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
  xmlns:image="http://www.google.com/schemas/sitemap-image/1.1"
  xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
  xsi:schemaLocation="
    http://www.sitemaps.org/schemas/sitemap/0.9
    http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd
    http://www.google.com/schemas/sitemap-image/1.1
    http://www.google.com/schemas/sitemap-image/1.1/sitemap-image.xsd"
>
  <url>
    <loc>https://www.example.com/press</loc>
    <lastmod>2016-08-11</lastmod>

    <changefreq>weekly</changefreq>
  </url>

  <url>
    <loc>https://www.example.com/about-faq</loc>
    <lastmod>2016-08-11</lastmod>

    <changefreq>weekly</changefreq>
  </url>


</urlset>

When I just had a regular sitemap everything worked great, but when I added in image sitemap markup assertValid started failing with:

E   DocumentInvalid: Element '{http://www.google.com/schemas/sitemap-image/1.1}image': No matching global element declaration available, but demanded by the strict wildcard., line 12

Or:

E   DocumentInvalid: Element '{http://www.sitemaps.org/schemas/sitemap/0.9}urlset': No matching global declaration available for the validation root., line 6

Upvotes: 3

Views: 3638

Answers (1)

Ghislain Fourny
Ghislain Fourny

Reputation: 7279

You could try to define a wrapper schema wrapper-schema.xsd that imports all the schemas needed, and use this schema with lxml instead of each one of the others.

<?xml version="1.0" encoding="UTF-8"?>
<xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema">
  <xs:import
    namespace="http://www.sitemaps.org/schemas/sitemap/0.9"
    schemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd"/>
  <xs:import
    namespace="http://www.google.com/schemas/sitemap-image/1.1"
    schemaLocation="http://www.google.com/schemas/sitemap-image/1.1/sitemap-image.xsd"/>
</xs:schema>

I don't have python, but this validates successfully in oXygen:

<?xml version="1.0" encoding="UTF-8"?>
<urlset  xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
    xmlns:image="http://www.google.com/schemas/sitemap-image/1.1"
    xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    xsi:noNamespaceSchemaLocation="wrapper-schema.xsd"
    >
    <image:image>
        <image:loc>http://www.example.com/image</image:loc>
    </image:image>
    <url>
        <loc>https://www.example.com/press</loc>
        <lastmod>2016-08-11</lastmod>
        <changefreq>weekly</changefreq>
    </url>
    <url>
        <loc>https://www.example.com/about-faq</loc>
        <lastmod>2016-08-11</lastmod>
        <changefreq>weekly</changefreq>
    </url>
</urlset>

Upvotes: 7

Related Questions