Agent Readiness Score
dagster.io
31 — Limited. Agents will struggle to discover or use this site without human help.
HonestClaw measured how well dagster.io's site and APIs work for AI agents — across 9 dimensions and 45 automated checks.
Dimensions
Discoverability12.1/24
Content Accessibility14.1/24
Bot Access Control0/12
Protocol & Capability Discovery3.5/41
Authentication & Credentials1.8/19
Documentation Quality8.5/10
Structured Data I/O0.5/13
Observable State & Reliability5.8/15
Agent Safety & Trust6.5/11
Checks
Discoverability
Subdomain sweepsubdomain-sweepAn agent-relevant subdomain is live and serves its expected content kind (docs.dagster.io).Parseable
robots.txtrobots-txtrobots.txt at https://dagster.io/robots.txt declares a sitemap. Declared sitemap https://dagster.io/sitemap.xml resolves as valid XML.Cross-verified
sitemap.xmlsitemap-xmlhttps://dagster.io/sitemap.xml is a valid sitemap (1169 location(s)), but without lastmod or non-homepage URLs.Parseable
Canonical domaincanonical-domainRoot and www converge on dagster.io, with a matching canonical tag.Cross-verified
API existenceapi-existenceNo API endpoint found at common paths (only HTML pages or 404s).Not detected
API catalogapi-catalogNo RFC 9727 API Catalog found at /.well-known/api-catalog.Not detected
API versioningapi-versioningThe API version lifecycle is documented at https://docs.dagster.io/api/api-lifecycle, including deprecation/sunset. (source: docs)Cross-verified
Content Accessibility
llms.txtllms-txtA curated llms.txt index is published at https://dagster.io/llms.txt: 40 links across 5 sections.Cross-verified
llms-full.txtllms-full-txtNo llms-full.txt file found (HTML pages at .txt paths do not qualify).Not detected
Freshness signalsfreshness-signalsA single freshness signal is present (Last-Modified header).Parseable
Crawl-cost estimatecrawl-cost-estimateInformational — not scoredA manageable sitemap (1169 page URLs) helps agents estimate crawl cost.Useful
Raw content extractabilityraw-content-extractabilityReadable content is extractable without JavaScript on 2 probed surface(s) with a strong main-content ratio (91% on the homepage).Cross-verified
ai.txtai-txtNo ai.txt file found (HTML pages at .txt paths do not qualify).Not detected
Markdown twinmarkdown-twinNo markdown twin found alongside probed docs HTML surfaces.Not detected
Bot Access Control
AI bot rulesai-bot-rulesrobots.txt is readable but declares no AI-bot-specific rules.Not detected
Content signalscontent-signalsrobots.txt is readable but declares no Content-Signal line.Not detected
RSL licensingrslrobots.txt is readable but declares no RSL License directive.Not detected
TDM reservationtdmrepNo TDMRep policy found at /.well-known/tdmrep.json.Not detected
Protocol & Capability Discovery
Link headerslink-headersNo RFC 8288 Link headers found on any probed response.Not detected
OpenAPI specificationopenapi-specNo OpenAPI/Swagger specification found.Not detected
MCP descriptormcp-descriptorInformational — not scoredNo MCP descriptor found at the standard locations an agent would check.Not detected
DNS-AIDdns-aidNo DNS-AID index found at _index._agents.dagster.io.Not detected
SDK availabilitysdk-availabilityNo SDK or client library documentation found.Not detected
MCP Server Cardmcp-server-cardNo MCP Server Card found at the standard locations an agent would check.Not detected
A2A Agent Carda2a-agent-cardNo A2A Agent Card found at the standard well-known locations.Not detected
.well-known indexwell-known-indexNo non-owned /.well-known/ descriptors found.Not detected
GraphQL surfacegraphql-surfaceNo GraphQL transport surface found at conventional paths (GET-only; no introspection issued).Not detected
Auth discoveryauth-discoveryNo standardized authentication-discovery surface found.Not detected
MCP supportmcp-supportA first-party MCP support page exists at https://docs.dagster.io/guides/labs/dagster-mcp, but it does not identify a concrete HTTPS MCP endpoint or fully establish a company-operated service.Parseable
Rate limit documentationrate-limit-docsA rate-limit documentation page exists at https://docs.dagster.io/deployment/dagster-plus/management/rate-limits, but it doesn't state a concrete limit alongside a rate-limit response header.Parseable
WebMCPwebmcpInformational — not scoredWebMCP browser probing is not yet available in this scanner release.Couldn't verify
Authentication & Credentials
Credential managementcredential-managementNo credential management documentation found at the standard docs locations an agent would check.Not detected
Programmatic auth flowprogrammatic-auth-flowNo programmatic authentication documentation found at the standard docs locations an agent would check.Not detected
Sandbox environmentsandbox-environmentNo sandbox or test environment documentation found at the standard docs locations an agent would check.Not detected
Auth documentationauth-documentationAn authentication documentation page exists at https://docs.dagster.io/deployment/dagster-plus/authentication-and-access-control, but it doesn't name a specific method or show how a request is authenticated.Parseable
Documentation Quality
API reference depthapi-reference-depthThe API reference at https://docs.dagster.io/api/rest-api documents parameters with example requests and responses. To reach the top level, it would need request and response bodies, authentication, pagination, and error codes.Useful
Changelog presencechangelog-presenceA changelog is published at https://docs.dagster.io/about/changelog with multiple recent dated entries, indicating it is actively maintained.Cross-verified
Structured Data I/O
Structured data I/Ostructured-data-ioNo published structured-data contract found (no typed spec response schemas).Not detected
Machine-readable pricingmachine-readable-pricingA response at https://dagster.io/pricing.json looks JSON-like but did not parse as JSON.Detected
Data export APIdata-export-apiData export is mentioned at https://dagster.io/glossary/data-export, but not on a page dedicated to documenting it.Detected
Observable State & Reliability
Status & health endpointsstatus-and-healthStatus page found at https://dagstercloud.statuspage.io/ (HTTP 200).Detected
Webhook documentationwebhook-documentationA webhook documentation page exists at https://docs.dagster.io/guides/labs/webhook-alerts, but it doesn't list specific event types with their payload shape.Parseable
Retry & idempotencyretry-and-idempotencyRetry/idempotency is documented at https://docs.dagster.io/deployment/execution/run-retries with an idempotency-key mechanism or a concrete retry strategy. To reach the top level, it would need an idempotency key and backoff/retry guidance together.Useful
Error documentationerror-documentationAn error documentation page exists at https://docs.dagster.io/deployment/troubleshooting/dbt-project-pydantic-validation-errors, but it doesn't enumerate specific error codes or a documented error response shape.Parseable
Machine payments (x402/MPP)x402-or-mpp-supportInformational — not scoredNo machine-payment signal observed (no HTTP 402, no payment-required response header, and no /.well-known/x402.json manifest). Payment support cannot be ruled out from an unauthenticated probe.Couldn't verify
Agent Safety & Trust
security.txtsecurity-txtNo security.txt found at /.well-known/security.txt or /security.txt.Not detected
Org identity signalsorg-identityHomepage exposes three org-identity signal types (legal_name, address, social).Useful
Metadata consistencymetadata-consistencyHomepage metadata (canonical, Open Graph, schema) is present and consistent.Cross-verified
Legal policy pageslegal-pagesBoth privacy and terms policies are discoverable with substantive content.Useful