One protocol. Any provider. User-controlled.
Apps request AI. The protocol delivers it.
@webinfer/client
A lightweight SDK that auto-connects to available AI sources. CallgenerateText(),generateImage(), orgenerateSpeech().
What it does:
You don't manage:
@webinfer/server
The brain that handles requests. Routes to the best provider—local or cloud—based on task, preferences, and availability.
What it does:
Runs in:
Import the client. Call a function. Ship AI features—no API keys, no server costs.
Just import @webinfer/client. The client connects to Chrome's built-in Gemini Nano, the user's OpenAI key, Ollama, or any configured provider—automatically.
Zero API Keys
Users bring their own.
Zero Server Costs
AI runs on user's side.
25+ Providers
One API handles all.
Want to move even faster? Check out AI Blocks— pre-built React components for chat, speech, images, and more. Copy, paste, ship.
Users connect their AI sources. The protocol routes each request to appropriate models and providers.
Someone browsing the web on Chrome desktop
Chrome's built-in AI. Free, on-device, private.
Ollama, LM Studio, or other local runners.
OpenAI, Anthropic, Google—your own API keys.
One subscription, 200+ models.
Company-provided AI. Paid by employer.
Free credits from app developers. Rate-limited.
Self-hosted gateway. Access from anywhere.
Casual User has access to 2 inference sources. The server automatically picks the best one for each request.
The server runs wherever you need it. Same protocol, different packaging.
Chrome & Chromium
Install once, works everywhere. Zero configuration. Perfect for getting started.
macOS, Windows, Linux
Works in every browser—Firefox, Safari, Edge, Arc. Run Python and C++ models locally.
Node.js
Lightweight daemon for developers. Run on your dev machine, Raspberry Pi, or home server.
Managed service
One subscription, 200+ models. No servers to manage. Works on any device.
Your infrastructure
Deploy on your servers. Issue tokens, enforce quotas, monitor usage.
Sign in to sync settings across devices. Or don't—everything works offline. No account required.
Connect your existing providers or discover new ones. Mix local with cloud. Switch without changing code.
Bring your own API keys
Run models on your hardware
Free, on-device, zero setup
Access multiple providers
Chrome's Gemini Nano runs entirely on your device. No API key, no cost, complete privacy. WebInfer uses it automatically when available.
Your AI, your infrastructure, your rules. Nodes connect and fall back to each other automatically.
Home server offline? Automatic fallback to cloud.
Local models first, cloud only when needed.
Sensitive requests stay on your hardware.
Distributed by design. Add nodes as needed.
LikeMCP servers, WebInfer servers can be discovered and added automatically. A standardized endpoint advertises capabilities.
/.well-known/webinfer.jsonEvery WebInfer server exposes a discovery endpoint. Clients can fetch server capabilities, available models, and authentication methods automatically.
{
"$schema": "webinfer.com/schemas/...",
"version": "1.0",
"protocol": "webinfer",
"provider": {
"id": "my-gateway",
"name": "My Gateway",
"type": "gateway"
},
"server": { "baseUrl": "..." },
"config": {
"fields": [
{ "key": "apiKey", "type": "password" }
]
},
"auth": { "methods": ["bearer"] },
"capabilities": ["chat", "image"],
"models": [{ "id": "gpt-4o" }],
"federation": { "supported": true }
}Paste the server URL. Discovery happens automatically.
Add your access token or API key if required.
Server models appear automatically. Set priority as needed.
Inspired by Model Context Protocol (MCP) server discovery patterns.
WebInfer Cloud provides managed infrastructure so you don't have to run anything yourself.
Access 200+ models from a single subscription. Use it across all apps that support the protocol.
Learn MoreGive your users free AI credits. No setup required on their end. Enforce quotas to prevent abuse.
For DevelopersFair question. Yes, we offer a cloud service. But here's the thing: we want competitors.
The protocol is designed to make inference portable. We hope many players will emerge—specialized models, domain-specific services, regional providers, budget options. That's the point.
Our cloud keeps a small platform fee to fund development of the protocol, the core libraries, and the fun parts. But you can always self-host, use your own API keys, or connect to competing services.
We're building plumbing, not a walled garden.
A standard protocol unlocks capabilities that fragmented integrations can't.
Stop paying $20 to ChatGPT, $10 to Notion AI, $30 to Grammarly—all using the same models.
Your data never touches app servers. It flows directly from your browser to your chosen AI provider.
Add AI to your app without managing API keys, billing, or infrastructure. Users bring their own compute.
Switch from OpenAI to Anthropic to local models without changing a line of code. Your choice, not the app's.
Run models on your own hardware. Chrome's built-in Gemini Nano, Ollama, LM Studio—all work seamlessly.
Apps built on the protocol automatically gain access to new models and providers as they launch.
Experimental. The protocol and SDK are functional and used by early adopters, but APIs may change. We're iterating based on real-world feedback.
Users bring their own provider—you don't manage API keys. Privacy is built-in since you never see user data. And your app works with 25+ providers automatically.
WebInfer integrates with Chrome's Gemini Nano when available. It provides a unified API regardless of whether AI runs locally or in the cloud.
Yes. Data flows directly from the browser to the user's chosen provider. WebInfer never sees prompt content or responses.
Yes, with caution. The protocol is stabilizing but may have breaking changes. Many sites are already using it successfully.
Install the extension to experience the protocol, or read the docs to integrate it into your app.