Meta tags:
description= 100% free and full open-source edge Firecrawl alternative with better links extraction for agents - that you can deploy to cloudflare or vercel by yourself. - lumpinif/deepcrawl;
Headings (most frequently used words):
uh, oh, navigation, code, saved, searches, deepcrawl, files, history, contributing, license, footer, search, repositories, users, issues, pull, requests, provide, feedback, lumpinif, menu, use, to, filter, your, results, more, quickly, folders, and, latest, commit, repository, documentation, star, about, releases, sponsor, this, project, packages, contributors, languages, topics, resources, of, conduct, security, policy, stars, watchers, forks,
Text of the page (most frequently used words):
and (17), code (16), security (13), github (13), #deepcrawl (13), open (9), you (8), this (8), reload (8), view (8), all (8), #contributing (7), with (7), your (7), please (6), page (6), license (6), links (6), source (6), json (6), enterprise (6), can (5), that (5), navigation (5), there (5), was (5), error (5), while (5), loading (5), better (5), agents (5), documentation (5), platform (5), use (5), search (5), community (4), readme (4), agent (4), extraction (4), for (4), public (4), pnpm (4), workspace (4), yaml (4), actions (4), issues (4), support (4), packages (3), stars (3), conduct (3), resources (3), tree (3), cloudflare (3), workers (3), markdown (3), topics (3), dev (3), 100 (3), free (3), full (3), firecrawl (3), alternative (3), more (3), files (3), commit (3), name (3), lumpinif (3), insights (3), pull (3), requests (3), signed (3), settings (3), another (3), tab (3), window (3), refresh (3), session (3), sign (3), saved (3), feedback (3), grade (3), features (3), copilot (3), solutions (3), explore (3), not (2), manage (2), docs (2), footer (2), 2026 (2), typescript (2), latest (2), repository (2), forks (2), 588 (2), policy (2), mit (2), tools (2), auth (2), html (2), web (2), scraping (2), nextjs (2), edge (2), deploy (2), vercel (2), yourself (2), about (2), star (2), history (2), read (2), the (2), context (2), cleaned (2), content (2), hierarchical (2), anti (2), change (2), development (2), turbo (2), tsconfig (2), lock (2), package (2), lint (2), staged (2), config (2), cjs (2), biome (2), jsonc (2), claude (2), auth_modes_and_workers (2), npmrc (2), gitignore (2), scripts (2), env (2), apps (2), vscode (2), husky (2), changeset (2), 819 (2), commits (2), last (2), message (2), menu (2), quality (2), projects (2), appearance (2), cancel (2), see (2), available (2), searches (2), repositories (2), business (2), advanced (2), developer (2), customer (2), services (2), devops (2), app (2), perform, action, time, share, personal, information, cookies, contact, status, privacy, terms, inc, other, mdx, languages, contributors, sponsor, project, release, feb, releases, report, watching, watchers, activity, nextjs16, orpc, sdk, cleaner, hono, scraper, crawling, built, felixlu, guide, visit, https, dashboard, api, database, transparent, oriented, website, data, extracts, favoured, metadata, llms, digest, minimal, token, cost, reduce, switching, hallucination, note, doesn, target, bot, purposes, optimized, high, frequency, workloads, scrape, pages, extract, ask, deepwiki, repo, performance, flexibility, warning, production, right, now, subject, still, under, rapid, own, risk, items, date, folders, file, tags, branches, main, additional, options, fork, must, notification, notifications, dismiss, alert, switched, accounts, out, resetting, focus, create, qualifiers, our, query, filter, results, quickly, submit, include, email, address, contacted, every, piece, take, input, very, seriously, provide, syntax, tips, clear, users, jump, pricing, premium, add, ons, powered, collections, trending, archive, program, accelerator, maintainer, lab, programs, fund, developers, sponsors, partners, trust, center, forum, skills, ebooks, reports, events, webinars, stories, type, software, topic, industries, government, manufacturing, financial, healthcare, industry, cases, devsecops, modernization, case, nonprofits, startups, small, medium, teams, enterprises, company, size, marketplace, changelog, blog, why, stop, leaks, before, they, start, secret, protection, secure, build, find, fix, vulnerabilities, application, changes, review, plan, track, work, instant, environments, codespaces, automate, any, workflow, workflows, integrate, external, mcp, registry, new, direct, from, issue, merge, write, creation, toggle, skip,
Text of the page (random words):
github lumpinif deepcrawl 100 free and full open source edge firecrawl alternative with better links extraction for agents that you can deploy to cloudflare or vercel by yourself github skip to content navigation menu toggle navigation sign in appearance settings platform ai code creation github copilot write better code with ai github copilot app direct agents from issue to merge mcp registry new integrate external tools developer workflows actions automate any workflow codespaces instant dev environments issues plan and track work code review manage code changes application security github advanced security find and fix vulnerabilities code security secure your code as you build secret protection stop leaks before they start explore why github documentation blog changelog marketplace view all features solutions by company size enterprises small and medium teams startups nonprofits by use case app modernization devsecops devops ci cd view all use cases by industry healthcare financial services manufacturing government view all industries view all solutions resources explore by topic ai software development devops security view all topics explore by type customer stories events webinars ebooks reports business insights github skills support services documentation customer support community forum trust center partners view all resources open source community github sponsors fund open source developers programs security lab maintainer community accelerator github stars archive program repositories topics trending collections enterprise enterprise solutions enterprise platform ai powered developer platform available add ons github advanced security enterprise grade security features copilot for business enterprise grade ai features premium support enterprise grade 24 7 support pricing search or jump to search code repositories users issues pull requests search clear search syntax tips provide feedback we read every piece of feedback and take your input very seriously include my email address so i can be contacted cancel submit feedback saved searches use saved searches to filter your results more quickly name query to see all available qualifiers see our documentation cancel create saved search sign in sign up appearance settings resetting focus you signed in with another tab or window reload to refresh your session you signed out in another tab or window reload to refresh your session you switched accounts on another tab or window reload to refresh your session dismiss alert message lumpinif deepcrawl public uh oh there was an error while loading please reload this page notifications you must be signed in to change notification settings fork 74 star 588 code issues 2 pull requests 0 actions projects security and quality 0 insights additional navigation options code issues pull requests actions projects security and quality insights lumpinif deepcrawl main branches tags go to file code open more actions menu folders and files name name last commit message last commit date latest commit history 1 819 commits 1 819 commits changeset changeset github github husky husky vscode vscode apps apps env env packages packages public public scripts scripts gitignore gitignore npmrc npmrc agents md agents md auth_modes_and_workers md auth_modes_and_workers md claude md claude md contributing md contributing md license license readme md readme md biome jsonc biome jsonc deepcrawl code workspace deepcrawl code workspace lint staged config cjs lint staged config cjs package json package json pnpm lock yaml pnpm lock yaml pnpm workspace yaml pnpm workspace yaml tsconfig json tsconfig json turbo json turbo json view all files repository files navigation readme code of conduct contributing mit license security more items deepcrawl warning do not use deepcrawl in production right now as it is subject to change and still under rapid development use at your own risk 100 free and open source firecrawl alternative with better performance and flexibility ask deepwiki about this repo note deepcrawl doesn t target anti scraping or anti bot purposes it s optimized for high frequency agent workloads that scrape public pages to extract cleaned markdown and a hierarchical links tree deepcrawl is an agent oriented website data context extraction platform it extracts cleaned markdown of page content agent favoured hierarchical links tree and metadata that llms can digest with minimal token cost to reduce context switching and hallucination full platform nextjs dashboard api workers auth workers and database is open and transparent documentation visit https deepcrawl dev docs to view the documentation contributing please read the contributing guide license open source open code built with ️ by felixlu star history about 100 free and full open source edge firecrawl alternative with better links extraction for agents that you can deploy to cloudflare or vercel by yourself deepcrawl dev topics typescript nextjs html to markdown crawling web scraper web scraping hono html cleaner ai sdk cloudflare workers links extraction links tree better auth ai agent tools orpc nextjs16 deepcrawl resources readme license mit license code of conduct code of conduct contributing contributing security policy security policy uh oh there was an error while loading please reload this page activity stars 588 stars watchers 5 watching forks 74 forks report repository releases 2 deepcrawl 0 5 5 latest feb 8 2026 1 release sponsor this project uh oh there was an error while loading please reload this page packages 0 uh oh there was an error while loading please reload this page contributors uh oh there was an error while loading please reload this page languages typescript 94 6 mdx 4 6 other 0 8 footer 2026 github inc footer navigation terms privacy security status community docs contact manage cookies do not share my personal information you can t perform that action at this time
|