What is a sitemap?

By the Variask team · Updated

Definition

A sitemap is an XML file that lists the pages on your site you want crawled, often with last modified dates. It helps search engines and other crawlers find your important pages.

Also called XML sitemap

With Variask: The free sitemap checker finds broken, redirected, noindexed and blocked pages in your sitemap.

How it works

  • List page addresses in an XML file.
  • Add lastmod dates so crawlers spot changes.
  • Large sites split into several sitemaps with an index.
  • List the sitemap in robots.txt and submit it in webmaster tools.

What it means for brands

  • Keep only live, indexable pages in your sitemap.
  • Update it automatically when pages change.

Questions

Sitemap:
common questions

Small, well linked sites can manage without one, but a sitemap is cheap and helps every crawler.

No. List only pages you want indexed.

Related terms

Keep exploring

Technical

robots.txt

robots.txt is a text file at the root of a website that tells crawlers, including AI crawlers, which parts of the site they may or may not visit.

Read

Technical

Crawl budget

Crawl budget is how many pages a crawler will fetch from your site in a given time. On large sites, wasting it on duplicate or low value pages can mean important pages are crawled less often by search and AI crawlers.

Read

Technical

IndexNow

IndexNow is an open protocol that lets a website tell participating search engines, such as Bing, that a page was added, changed or removed, so it can be crawled sooner. Faster indexing in Bing also helps Copilot and other features that use Bing's index.

Read
Full glossary