# TaskPool.ai — robots policy.
#
# Deliberately permissive: page-level exclusion is done with <meta name="robots" content="noindex">
# on every private/app page (console, settings, staff, token pages), NOT here. A crawler must be ALLOWED to fetch a page to see its noindex
# tag, so disallowing those paths would be counter-productive (they would stay eligible for indexing
# from inbound links, just uncrawled). So this allows everything and points at the sitemap of the
# pages we do want indexed.
#
# The deployed dev stack (dev.taskpool.ai) serves this same file but sits behind Cloudflare Access, so
# no crawler ever reaches it — the absolute prod URL below is correct for the only host that matters.

User-agent: *
Allow: /

Sitemap: https://taskpool.ai/sitemap.xml