Available now: 136 tested scrapers. Open a card for the data it extracts, the price, and how to get access.

Websites & SEO

Sitemap URL Extractor

Tested and ready

Get every URL of a website from its XML sitemaps: auto-discovers sitemaps via robots.txt, follows sitemap indexes, reads .gz files, and returns URL, lastmod, priority and image counts. Filter by regex or 'modified after' to catch new and updated pages.

What data it extracts

  • website
  • url
  • lastmod
  • changefreq
  • priority
  • images
  • Has Hreflang
  • sitemap
  • Scraped At

Output format

Each run writes an Apify dataset you can download as JSON, CSV or Excel, or read through the Apify API.

Schedule

Run it on demand in the Apify Console, or put it on an hourly, daily or weekly schedule.

Price

$0.45 per 1,000 results

Pay per result.

Get access

This scraper is available. Request access and we’ll set you up today.

Use the request form on this site, or email [email protected].