WebInfer

Providers

Connect to 25+ AI providers. Users configure them once, your app uses them automatically.

What are Providers?

Providers are AI service adapters that connect WebInfer to different AI backends—cloud APIs, local runners, and gateways.

For users: Configure providers once in the extension or native app. Add API keys, set priorities, and WebInfer handles the rest.

For developers: You don't manage providers. When your app calls generateText(), WebInfer automatically routes to the user's configured providers.

Provider Types

Cloud APIs

Direct connections to AI providers like OpenAI, Anthropic, Google, and Mistral. Users add their own API keys.

Local Runners

Run models on your own hardware with Ollama or LM Studio. Complete privacy, zero external data sharing.

Aggregators

Services like OpenRouter and Portkey that provide access to 100+ models through a single API key.

Gateways

Self-hosted or cloud WebInfer endpoints. Developers can provide courtesy compute to users via gateways.

Supported Providers

AnthropicAzure OpenAIChrome Built-in AICloudflare AICohereDeepSeekFireworks AIGoogle AI (Gemini)Google Vertex AIGroqLM StudioMistral AIOllamaOpenAIOpenRouterPortkeyTogether.aiWebInfer Gateway

How Provider Selection Works

When your app makes an AI request, WebInfer's routing engine automatically selects the best provider based on:

  • Task type — text, image, audio, code generation
  • User priorities — preferred providers, cost vs quality tradeoffs
  • Model capabilities — context length, multimodal support, specialized skills
  • Availability — fallback to next provider if one fails
Learn more about model routing

Add Provider from URL

WebInfer supports auto-discovery of gateways and daemons. Paste a URL and WebInfer automatically fetches the provider's capabilities and configuration.

In-App Discovery

Go to Settings → Integrations and click "Add from URL".

https://gateway.company.com

CLI Discovery

Add providers via CLI with automatic discovery.

webinfer provider add https://llm.acme.com

Discovery works with:

Self-hosted gateways
Local daemons
WebInfer cloud

Configuring Providers (Users)

1. Add API Keys
Go to the Providers page in the extension or playground. Click on a provider and enter your API key.
2. Set Priorities
Drag providers to reorder them. Higher priority providers are preferred when routing requests.
3. Enable/Disable
Toggle providers on/off. Disabled providers won't be used even if they have API keys configured.

Next Steps

Configure Providers

Add API keys and set priorities

Settings → Integrations →
Set Up a Gateway

Provide courtesy compute to your users

Gateway Docs →