LLM API Proxy

Connect your AI tools to models from different providers

By rxliuli

InstallOpens in your own Appflare
Stars
152
152 stars on the app's GitHub repository.
Installs
Under 10
Fewer than 10 Appflare users run this app, from anonymous usage data; smaller counts are not published.
Plan
Free
Runs on Cloudflare's free Workers plan.
License
GPL-3.0-only
An open-source license: you may use, change and share the app on its terms.
Version
Dec 1, 2025
Version 0.0.0-20251201.43db1c0.
Last tested
Oct 14
The catalog installed this version in a test account and it answered, on Oct 14, 2026.

About

A self-hosted alternative to LiteLLM.

One OpenAI-compatible (and Ollama-compatible) API in front of OpenAI, Anthropic, Gemini, DeepSeek, Groq, Grok, OpenRouter, Azure OpenAI and more, using your own provider keys behind a key of its own.

Features

  • Use OpenAI-compatible tools with your own AI provider API keys
  • Switch between providers by choosing a different model
  • Connect tools that use the Ollama interface
  • Give clients one access key while keeping provider keys private
  • List the models available from your configured providers

Deploy LLM API Proxy on Cloudflare

  1. Step 1: Set up Appflare in your Cloudflare account

    Once

    Appflare installs itself into your own Cloudflare account from your browser, and runs on the free Workers plan, as LLM API Proxy does. See what LLM API Proxy needs on your account.

    Set up AppflareAlready have Appflare? Install LLM API Proxy

  2. Step 2: Install LLM API Proxy

    LLM API Proxy needs no keys or settings from you.

    Appflare generates a value for you: Proxy API key.

    It also has 26 optional settings you can leave for later.

    One switch on the form puts LLM API Proxy behind Cloudflare Access, so only the people who use your Appflare can open it.

  3. Step 3: Finish setting it up

    After the install, Appflare shows two short steps for LLM API Proxy, on its page.

With Appflare instead of by hand

  • Nothing to build on your computerAppflare sets itself up from your browser, with no API token to create and nothing to install.
  • Updates in one clickAppflare tells you when the catalog has a new version, and Update installs it.
  • Health checksAfter every install and update, Appflare checks that the app answers.
  • It stays in your own accountEverything runs on your Cloudflare account and your plan, and Appflare records what it creates, so an uninstall removes it.

What it needs on your account

Nothing beyond a Cloudflare account on the free Workers plan.

Questions

Does LLM API Proxy run on Cloudflare's free plan?

Yes. LLM API Proxy runs on Cloudflare's free Workers plan, and so does Appflare.

What does LLM API Proxy create in my Cloudflare account?

Appflare creates a Worker for LLM API Proxy. Appflare records each resource it creates; an uninstall deletes them, keeping any data you choose to keep.

How do I update LLM API Proxy?

When the catalog has a new version, LLM API Proxy's page in Appflare says Update available. Select Update: Appflare takes a snapshot first, so you can roll back to the version before. You can also let Appflare update it automatically.

Is LLM API Proxy open source?

Yes, under GPL-3.0-only. An open-source license: you may use, change and share the app on its terms. Its source code is at github.com/rxliuli/llm-api-proxy.

Links

Packaged for the catalog by MendyLanda.

Author

Categories