Direqt Crawlers & User Agents

Direqt uses web crawlers (“robots”) and user agents to perform actions for its products, either automatically or triggered by user request. Direqt uses the following robots.txt tags to enable webmasters to manage how their sites and content work with our product.

User agent header Anomura/1.2 (+https://www.direqt.ai)

User agent token Anomura

---

Overview

Anomura is for search. Anomura is used to link to and surface websites in search results in Direqt’s search features. It is not used to crawl content to train any models.

To help ensure your site appears in search results, we recommend allowing Anomura in your site’s robots.txt file and allowing requests from our published IP ranges below.

Note: The full user-agent string will contain ; Anomura/1.2 (+https://www.direqt.ai).

---

User agents

Agent	Token	Full user-agent string	Purpose
Anomura	Anomura	Anomura/1.2 (+https://www.direqt.ai)	Direqt search crawler. Discovers links/metadata to surface in search. Not used for model training.

---

Control access with robots.txt

By default, Anomura follows standard robots.txt directives addressed to the Anomura token.

Allow Anomura everywhere

User-agent: Anomura
Allow: /

Block Anomura completely

User-agent: Anomura
Disallow: /

Blocking Anomura means your content will not appear in Direqt search features.

Allow Anomura but block a specific path

User-agent: Anomura
Disallow: /private/

Allow Anomura while blocking all other crawlers

# robots.txt
User-agent: *
Disallow: /

User-agent: Anomura
Allow: /

---

Source IP ranges

Allow traffic from the following IP to ensure Anomura can access your site when permitted by your robots.txt and server configuration.

• Hostname: crawler.direqt.ai

• Published IP address: 34.56.242.161

---

FAQ

Does Anomura train Direqt models? No. Anomura is only used to discover and surface links and metadata for Direqt search features. Content fetched by Anomura is not used for model training.

Does Anomura respect robots.txt? Yes. Anomura follows standard robots.txt directives for the Anomura user agent token.

Will you add more IPs? If additional IPs or ranges are published, we’ll update this page. Consider allowlisting by both user-agent and IP where possible.