For the complete documentation index, see llms.txt. This page is also available as Markdown.

Indexing Troubleshooting

Common errors related to the indexing process and how to resolve them

No Sitemap Found

This error occurs when no valid sitemap is detected at the expected location. A valid sitemap at your site root is recommended for optimal search performance.

Troubleshooting Steps

  1. Create a Sitemap

    If your site doesn't have a sitemap, generate a sitemap in XML format following the Sitemaps.org protocol.

  2. Place the Sitemap at Your Site Root

    Ensure your sitemap is posted at your site root (e.g., https://yourdomain.com/sitemap.xml)

Invalid URL

This error occurs when the provided URL is incorrectly formatted, inaccessible, or blocked.

Troubleshooting Steps

  1. Check the URL Format

Common issues:

  • The URL is missing https:// or http:// (e.g., example.com/page instead of https://example.com/page).

  • The URL contains spaces, special characters, or encoding errors.

  • The URL is a relative path instead of a full link (e.g., /page instead of https://example.com/page).

  1. Verify URL Accessibility

Common issues:

  • The URL returns a 404 (Not Found) or 403 (Forbidden) error.

  • The page is behind a login screen or restricted to specific users.

  • The website is temporarily down

  • The page has a noindex meta tag preventing search engines from accessing it.

  • The website has firewall or security settings blocking our crawler.

Last updated