Robots.txt
Crawl directives for search engine bots
User-agent: * Allow: / # Sitemaps Sitemap: https://digitalhotwire.com/sitemap # Disallow admin and internal paths Disallow: /api/ Disallow: /_next/ # Crawl-delay (optional, for polite crawling) Crawl-delay: 1
This page serves as a human-readable reference for our crawl directives. Search engine bots should reference the actual robots.txt file at the root of the domain.