Cintesa-Ingestion

Site ingestion on Cintesa identifies itself with this User-Agent:

Cintesa-Ingestion/1.0 (+https://cintesa.run/bot)

• Full-site crawls respect robots.txt by default.
• Requests are rate-limited with polite per-domain delays.
• Operators must confirm they have the legal right to ingest the target site before website ingestion starts (see Terms of Service).
• Site owners may block this agent via robots.txt or server rules.
• When a site blocks this agent, admins see an actionable error instead of an empty successful crawl.