Skip to content
Verified connector

Website Crawler — Markdown Pages, Sitemaps & RAG Provenance

io.github.kriton-dev/website-to-markdown

Crawl sites to Markdown with sitemaps, globs and depth limits, obeying robots and crawl-delay

Install surfaces

How Website Crawler — Markdown Pages, Sitemaps & RAG Provenance runs, per the official MCP registry entry.

  • streamable-http
    https://mcp.apify.com/?tools=hermeskd/website-to-markdown

Governed execution

How KLA gates calls to Website Crawler — Markdown Pages, Sitemaps & RAG Provenance once it is connected.

A published policy defines which Website Crawler — Markdown Pages, Sitemaps & RAG Provenance actions an agent may take and under what conditions. Each call passes through a policy gate at the tool-call boundary. Permitted actions execute, with the policy basis recorded. Flagged actions execute and are sampled for scheduled human review. High-stakes actions pause and route to a named reviewer on the Decision Desk. The call, the policy decision, and any approval are sealed as an evidence record.

Browse all connectors

KLA also governs the agents and model providers you already run. See integrations.

Website Crawler — Markdown Pages, Sitemaps & RAG Provenance MCP connector