Skip to content

nathabonfim59/md-fetch

Repository files navigation

md-fetch logo

md-fetch

A powerful command-line tool that fetches web content and converts it to clean, readable Markdown format, optimized for AI and LLMs.

Docs License

Key Features

  • Bypass Anti-Scraping: Uses real headless browsers (Chrome/Firefox) or curl to get content.
  • AI-Optimized: Strips noise (scripts, styles, ads) to produce token-efficient Markdown.
  • Server Mode: REST API for single or batch URL processing with parallel execution.
  • Agent Ready: Ships with a specialized Agent Skill for OpenCode, Gemini CLI, and Claude Code.

Learn more about Features & Why Use Real Browsers →

Quick Start

Installation

# Using Shell Script (Linux & macOS)
curl -fsSL https://raw.githubusercontent.com/nathabonfim59/md-fetch/main/install.sh | sh

# Using Go
go install github.com/nathabonfim59/md-fetch@latest

Detailed Installation Guide (Releases, Source, etc.) →

Basic Usage

# Fetch a URL to terminal
md-fetch https://example.com

# Save as Markdown file
md-fetch --save https://example.com

# Use a specific browser
md-fetch --browser firefox https://example.com

Browser Support & Troubleshooting →

Server Mode

# Start REST API server
md-fetch serve --port 8080

Full Server Mode & API Guide →

Documentation

License

This project is licensed under the MIT License - see the LICENSE file for details.

About

A CLI tool and REST API that converts web content to clean Markdown, bypassing anti-scraping measures using headless browsers. Perfect for AI/LLM applications

Topics

Resources

License

Stars

Watchers

Forks

Packages

 
 
 

Contributors