# probe402 - The Machine Commerce Observatory: The independent measurement and evidence layer for machine commerce.
#
# Operated by Zach Bucheister. Contact: hello@probe402.com
# Who we are, exactly what our prober sends, how to make it stop, and how to contest a
# reading: https://probe402.com/method
#
# To write a rule aimed at our prober specifically, the product token is: probe402
# We read robots.txt for every host we probe and honour it per RFC 9309, with one departure
# that is stated on the method page rather than hidden.
#
# This file is served by probe402's own Worker and carries the response header
# x-probe402-path: public. A policy at this URL without that header was substituted in front
# of us and is not ours - which is not hypothetical, it is what stood here until 2026-08-21.
#
# Nothing is disallowed. Paid depth of history is served through a metered API that answers 402 to every
# unpaid request; it is not crawled out of these paths, so there is nothing to hide behind a
# Disallow. The content signals below are ours: we want to be found and cited.
# ai-train is deliberately UNSET - under the content-signals specification an
# omitted signal is neither granted nor restricted.

User-agent: *
Content-Signal: search=yes, ai-input=yes
Allow: /
Disallow:

Sitemap: https://probe402.com/sitemap.xml