AdaEcosystemCrawlerWebmaster information
About AdaEcosystemCrawler
This page identifies the crawler used to discover public resources for Ada Ecosystem and explains how site operators can control its access.
AdaEcosystemCrawler/<version> (+https://adaecosystem.com/crawler)Purpose and scope
Focused on the Ada programming language.
AdaEcosystemCrawler is intended to discover public pages and files that identify, document, distribute, discuss, or provide evidence for resources materially related to Ada and SPARK.
It is not intended to be a general-purpose crawler. Catalog results direct users to the original site for the full resource.
Crawler behavior
Designed to respect site controls.
The crawler is designed to read robots.txt, apply per-origin pacing, avoid obvious login and state-changing surfaces, and retain enough diagnostic information to investigate reports.
If its behavior does not match those expectations, please report it.
Allow
Explicitly permit the crawler
User-agent: AdaEcosystemCrawler
Allow: /Use the stable product token; site rules do not need to match a version number.
Restrict
Exclude paths you do not want crawled
User-agent: AdaEcosystemCrawler
Disallow: /private/
Disallow: /drafts/A public rule is the clearest way to express path restrictions.
Pacing
Request a slower crawl
User-agent: AdaEcosystemCrawler
Crawl-delay: 10Where a pacing directive is present, the crawler is designed to combine it with its own per-origin limits and use the more restrictive behavior.
Report a problem or grant specific permission
Include enough detail to identify the request.
Send the hostname, path, approximate timestamp, observed user-agent, and behavior. For non-public permission, state the allowed paths and pacing requirements explicitly.