Deepcrawl

Turn web pages into clean text and organized links

By Felix Lu

InstallOpens in your own Appflare
Stars
689
689 stars on the app's GitHub repository.
Installs
Under 10
Fewer than 10 Appflare users run this app, from anonymous usage data; smaller counts are not published.
Plan
Free
Runs on Cloudflare's free Workers plan.
License
MIT
An open-source license: you may use, change and share the app on its terms.
Version
0.5.5
Version 0.5.5.
Last tested
Oct 14
The catalog installed this version in a test account and it answered, on Oct 14, 2026.

About

A self-hosted alternative to Firecrawl.

An open-source Firecrawl alternative: an API that turns public web pages into clean Markdown, metadata and a tree of their links for AI agents, cached in KV with request logs in D1.

Features

  • Extract page text as Markdown for AI tools
  • Get a page's links grouped into a tree
  • Get page details alongside the extracted text

Deploy Deepcrawl on Cloudflare

  1. Step 1: Set up Appflare in your Cloudflare account

    Once

    Appflare installs itself into your own Cloudflare account from your browser, and runs on the free Workers plan, as Deepcrawl does. See what Deepcrawl needs on your account.

    Set up AppflareAlready have Appflare? Install Deepcrawl

  2. Step 2: Install Deepcrawl

    Deepcrawl needs no keys or settings from you.

    Appflare generates a value for you: Token signing secret.

    It also has six optional settings you can leave for later.

    One switch on the form puts Deepcrawl behind Cloudflare Access, so only the people who use your Appflare can open it.

  3. Step 3: Finish setting it up

    After the install, Appflare shows two short steps for Deepcrawl, on its page.

With Appflare instead of by hand

  • Nothing to build on your computerAppflare sets itself up from your browser, with no API token to create and nothing to install.
  • Updates in one clickAppflare tells you when the catalog has a new version, and Update installs it.
  • Health checksAfter every install and update, Appflare checks that the app answers.
  • It stays in your own accountEverything runs on your Cloudflare account and your plan, and Appflare records what it creates, so an uninstall removes it.

What it needs on your account

  • KV storageThis app uses it
  • D1 databaseThis app uses it

Questions

Does Deepcrawl run on Cloudflare's free plan?

Yes. Deepcrawl runs on Cloudflare's free Workers plan, and so does Appflare.

What does Deepcrawl create in my Cloudflare account?

Appflare creates a Worker for Deepcrawl and the resources it uses: KV namespaces and D1 databases. Appflare records each resource it creates; an uninstall deletes them, keeping any data you choose to keep.

How do I update Deepcrawl?

When the catalog has a new version, Deepcrawl's page in Appflare says Update available. Select Update: Appflare takes a snapshot first, so you can roll back to the version before. You can also let Appflare update it automatically.

Is Deepcrawl open source?

Yes, under MIT. An open-source license: you may use, change and share the app on its terms. Its source code is at github.com/lumpinif/deepcrawl.

Links

Packaged for the catalog by MendyLanda.

Author

Categories