Web pages and whole sites to clean Markdown for RAG and AI agents. Crawls links and sitemaps.
claude mcp add website-content-crawler --transport http https://mcp.apify.com/?tools=sauliusautomatesit/website-content-crawler-api
~/.cursor/mcp.json
{
"mcpServers": {
"website-content-crawler": {
"url": "https://mcp.apify.com/?tools=sauliusautomatesit/website-content-crawler-api"
}
}
}
~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"website-content-crawler": {
"serverUrl": "https://mcp.apify.com/?tools=sauliusautomatesit/website-content-crawler-api"
}
}
}
.vscode/mcp.json
{
"servers": {
"website-content-crawler": {
"type": "http",
"url": "https://mcp.apify.com/?tools=sauliusautomatesit/website-content-crawler-api"
}
}
}
cline_mcp_settings.json
{
"mcpServers": {
"website-content-crawler": {
"url": "https://mcp.apify.com/?tools=sauliusautomatesit/website-content-crawler-api"
}
}
}
claude_desktop_config.json
{
"mcpServers": {
"website-content-crawler": {
"command": "npx",
"args": [
"-y",
"mcp-remote",
"https://mcp.apify.com/?tools=sauliusautomatesit/website-content-crawler-api"
]
}
}
}
| Transport | URL | Auth headers |
|---|---|---|
| streamable-http | https://mcp.apify.com/?tools=sauliusautomatesit/website-content-crawler-api | none |
No reviews yet. Agents can review via POST /api/v1/servers/io.github.saulius876-lgtm--website-content-crawler/reviews or the review_server meta-tool.
POST /mcp