Releases·Tool Release
Built a lightweight tool to clean noisy web pages into compact Markdown for RAG pipelines (saves ~85% tokens)
A developer shared an open-source micro-service that strips junk from scraped HTML (scripts, styles, navbars, footers, ads) and outputs clean semantic Markdown for LangChain agents and RAG vector stores. It cuts raw HTML token footprint by up to 85% and runs with sub-second response times, addressing token waste in RAG prompt contexts.
10 engagement1 sourceWed, Sep 9, 2026, 06:49 PM
AI Overview
- The open-source micro-service strips scripts, styles, navbars, footers, and ad containers while retaining markdown headings, lists, links, and tables.
- It runs in sub-second response time and is self-hostable via Docker (github.com/Okumotinho/clean-web-markdown-extractor) or free on RapidAPI (50 calls/month).
Related
Products·launched
R# Markdown Scraper API: converts web pages to LLM-ready Markdown
A web scraping API that turns complex, JavaScript-heavy pages into clean structured Markdown optimized for LLMs, RAG pipelines, and AI agents. It handles rendering, DOM transformation, and anti-bot bypass. Backend is hosted on Render with Zuplo handling API keys and billing.
A web scraping API that turns complex, JavaScript-heavy pages into clean structured Markdown optimized for LLMs, RAG pipelines, and AI agents. It handles rendering, DOM transformation, and anti-bot bypass. Backend is hosted on Render with Zuplo handling API keys and billing.
3 engagement1 sourceredditThu, Oct 8, 2026, 05:57 PM
Products·launched
URL to clean Markdown MCP server for RAG pipelines
A small MCP server that converts a URL into clean Markdown, stripping out navigation bars, cookie banners, and other clutter. It uses Mozilla Readability to extract the main article content and converts it to GitHub-flavored Markdown, preserving headings, tables, lists, and code blocks. Designed for developers building RAG pipelines who need clean text for vector databases.
A small MCP server that converts a URL into clean Markdown, stripping out navigation bars, cookie banners, and other clutter. It uses Mozilla Readability to extract the main article content and converts it to GitHub-flavored Markdown, preserving headings, tables, lists, and code blocks. Designed for developers building RAG pipelines who need clean text for vector databases.
1 engagement1 sourceredditThu, Jul 23, 2026, 11:53 PM
Releases·Tool Release
Clean Web-to-Markdown API for LangChain RAG pipelines (handles Cloudflare/Turnstile & cuts token costs)
A developer introduced Clean Web to Markdown & RAG Scraper, an API that converts web pages to markdown for LangChain RAG pipelines, handling bot-protected domains and cutting wasted context tokens. It targets a common ingestion pain point: raw HTML loaders waste tokens and fail on protected sites.
A developer introduced Clean Web to Markdown & RAG Scraper, an API that converts web pages to markdown for LangChain RAG pipelines, handling bot-protected domains and cutting wasted context tokens. It targets a common ingestion pain point: raw HTML loaders waste tokens and fail on protected sites.
4 engagement1 sourceredditSat, Sep 5, 2026, 11:52 AM
Products·launched
AST-based Web-to-Markdown Crawler for RAG pipelines
An Apify Actor that converts web pages to clean Markdown using AST parsing, preserving document hierarchy for better RAG retrieval. It removes noise like navbars and scripts, and outputs structured Markdown that improves chunking and retrieval accuracy. Built for developers building RAG pipelines or AI agents that consume web content.
An Apify Actor that converts web pages to clean Markdown using AST parsing, preserving document hierarchy for better RAG retrieval. It removes noise like navbars and scripts, and outputs structured Markdown that improves chunking and retrieval accuracy. Built for developers building RAG pipelines or AI agents that consume web content.
0304 engagement3 sourcesredditThu, Jul 23, 2026, 03:01 PM
Products·launched
Web2MD – turn any URL into clean Markdown for AI agents
Web2MD is an open-source tool (and MCP server) that fetches a web page and converts it into clean Markdown. It is intended for AI agents and LLM pipelines that need readable web content instead of raw HTML. It solves the problem of noisy page clutter (ads, scripts, markup) when feeding URLs to models.
Web2MD is an open-source tool (and MCP server) that fetches a web page and converts it into clean Markdown. It is intended for AI agents and LLM pipelines that need readable web content instead of raw HTML. It solves the problem of noisy page clutter (ads, scripts, markup) when feeding URLs to models.
2 engagement1 sourcehackernewsSat, Oct 3, 2026, 01:36 PM