Directory / api.x402node.dev
api.x402node.dev/web/robots working
https://api.x402node.dev/web/robots
Before you pay
- Advice
ok- Protocol
- x402 · http · GET
- Asks for
- 0.005 USDC on base
- Catalogue says
- 0.005 USDC
- Pays to
0x4466d4A84b7c49a6A094ec6eef4a0712D6dd125e- Last check
- 26 min ago · 165 ms · HTTP 402
- Detail
- 402 with valid terms
Reliability
- Uptime 24 h
- 100.0%
- Uptime 7 days
- 100.0% (5 checks)
- Paid calls 30 d
- 1 from 1 payers (x402 Bazaar)
- Listed by
- x402-bazaar
- First seen
- 2026-11-05 22:27 UTC
Description (from the catalogue, unverified)
Fetch and parse robots.txt for a domain. Returns parsed allow/disallow rules per user-agent, sitemap URLs, crawl-delay directives, and raw content. Built for AI agents planning ethical web crawling and SEO audit. Use ?domain=example.com. Accepts payment on Base or Solana — either network works.
Signed history
No signed statements yet: status changes, daily summaries and live checks appear here.
Verify any statement offline: how.
For agents and owners
JSON: https://alalanet.com/v1/services/b656h2hml2m3z3l4
Badge:
<a href="https://alalanet.com/s/b656h2hml2m3z3l4"><img src="https://alalanet.com/badge/b656h2hml2m3z3l4" alt="alalanet status"></a>
Own this service? Get verified. Do not want it checked? See the prober page.