WebCrawl 0.0.3

{
  "servers": {
    "WebCrawl": {
      "type": "stdio",
      "command": "dnx",
      "args": ["WebCrawl@0.0.3", "--yes"]
    }
  }
}
                    
This package contains an MCP Server. The server can be used in VS Code by copying the generated JSON to your VS Code workspace's .vscode/mcp.json settings file.
dotnet tool install --global WebCrawl --version 0.0.3
                    
This package contains a .NET tool you can call from the shell/command line.
dotnet new tool-manifest
                    
if you are setting up this repo
dotnet tool install --local WebCrawl --version 0.0.3
                    
This package contains a .NET tool you can call from the shell/command line.
#tool dotnet:?package=WebCrawl&version=0.0.3
                    
nuke :add-package WebCrawl --version 0.0.3
                    

WebCrawl MCP Server

An MCP (Model Context Protocol) server that crawls web pages and returns their text content.

Prerequisites

Tools

Crawl

Crawls a web page at the given URL and returns its text content.

Parameters:

Name Type Description
url string The URL of the web page to crawl.

The tool fetches the HTML from the specified URL, strips scripts, styles, and tags, decodes HTML entities, and returns clean readable text.

Getting Started

Build

dotnet build

Run

dotnet run --project WebCrawl

The server communicates over stdio using the MCP protocol.

Install as an MCP Server

Add the following to your MCP client configuration:

{
  "mcpServers": {
    "WebCrawl": {
      "type": "stdio",
      "command": "dnx",
      "args": ["WebCrawl", "--version", "0.0.1", "--yes"]
    }
  }
}

Project Structure

WebCrawl/
├── Program.cs        # Host setup and MCP server registration
├── WebCrawlTool.cs   # Crawl tool implementation
└── WebCrawl.csproj   # Project file

License

This project is open source. See the repository for license details.

Product Compatible and additional computed target framework versions.
.NET net10.0 is compatible.  net10.0-android was computed.  net10.0-browser was computed.  net10.0-ios was computed.  net10.0-maccatalyst was computed.  net10.0-macos was computed.  net10.0-tvos was computed.  net10.0-windows was computed. 
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.

This package has no dependencies.

Version Downloads Last Updated
0.0.3 146 2/16/2026
0.0.2 127 2/15/2026
0.0.2-alpha 123 2/15/2026
0.0.1 124 2/15/2026