WebInfer

🔗

WebInfer Gateway

Connect to remote WebInfer gateway servers for federated inference

Free
Gateway & Aggregator
API

Configure WebInfer Gateway

Add your WebInfer Gateway API key in Settings

Go to Settings
About WebInfer Gateway

Route requests through another WebInfer gateway instance. Enables federated inference across multiple gateway nodes, organization-hosted gateways, or fallback to other resources. Creates a true "web of computing nodes" where gateways can connect to each other.

Key Features
  • Federation between gateway instances
  • Organization-hosted private gateways
  • Fallback to other gateways when primary fails
  • Full streaming support
  • Token-gated or API-key authentication
  • Geographic routing to nearest gateway
Capabilities
chat
gateway
federation
streaming
Configuration Schema
Required and optional fields for configuring this provider
FieldTypeRequired
gatewayUrl
url
Required
apiKey
password
Optional
accessToken
password
Optional
timeout
number
Optional
CLI Usage
For users running the daemon server locally or a self-hosted gateway

Add provider:

npx webinfer provider add webinfer-server --key YOUR_API_KEY

Test connection:

npx webinfer provider test webinfer-server

Get your API key from https://webinfer.com/docs/gateways

Programmatic Usage
Use WebInfer Gateway in your code with WebInfer

Basic usage:

import { generateText } from "webinfer"

// WebInfer automatically routes to the best available provider
const result = await generateText({
  prompt: "Write a haiku about programming"
})

console.log(result.text)

Specify WebInfer Gateway explicitly:

import { generateText } from "webinfer"

const result = await generateText({
  prompt: "Write a haiku about programming",
  provider: "webinfer-server"
})

console.log(result.text)
console.log("Provider:", result.provider)
console.log("Model:", result.model)

Streaming:

import { streamText } from "webinfer"

const { textStream } = await streamText({
  prompt: "Write a story about AI",
  provider: "webinfer-server"
})

for await (const chunk of textStream) {
  process.stdout.write(chunk)
}
Pricing
Free
Cost depends on target gateway configuration. Self-hosted gateways are free.