WebInfer

💰

DeepInfra

Cost-effective model hosting

Budget
Fast & Cost-Effective
API

Configure DeepInfra

Add your DeepInfra API key in Settings

Go to Settings
Capabilities
chat
embeddings
budget
Configuration Schema
Required and optional fields for configuring this provider
FieldTypeRequired
apiKey
password
Required
CLI Usage
For users running the daemon server locally or a self-hosted gateway

Add provider:

npx webinfer provider add deepinfra --key YOUR_API_KEY

Test connection:

npx webinfer provider test deepinfra

Get your API key from https://deepinfra.com/

Programmatic Usage
Use DeepInfra in your code with WebInfer

Basic usage:

import { generateText } from "webinfer"

// WebInfer automatically routes to the best available provider
const result = await generateText({
  prompt: "Write a haiku about programming"
})

console.log(result.text)

Specify DeepInfra explicitly:

import { generateText } from "webinfer"

const result = await generateText({
  prompt: "Write a haiku about programming",
  provider: "deepinfra"
})

console.log(result.text)
console.log("Provider:", result.provider)
console.log("Model:", result.model)

Streaming:

import { streamText } from "webinfer"

const { textStream } = await streamText({
  prompt: "Write a story about AI",
  provider: "deepinfra"
})

for await (const chunk of textStream) {
  process.stdout.write(chunk)
}