WebInfer

🏗️

Baseten

Model deployment platform

Budget
Specialized
API

Configure Baseten

Add your Baseten API key in Settings

Go to Settings
Capabilities
chat
custom-deployments
Configuration Schema
Required and optional fields for configuring this provider
FieldTypeRequired
apiKey
password
Required
CLI Usage
For users running the daemon server locally or a self-hosted gateway

Add provider:

npx webinfer provider add baseten --key YOUR_API_KEY

Test connection:

npx webinfer provider test baseten

Get your API key from https://www.baseten.co/

Programmatic Usage
Use Baseten in your code with WebInfer

Basic usage:

import { generateText } from "webinfer"

// WebInfer automatically routes to the best available provider
const result = await generateText({
  prompt: "Write a haiku about programming"
})

console.log(result.text)

Specify Baseten explicitly:

import { generateText } from "webinfer"

const result = await generateText({
  prompt: "Write a haiku about programming",
  provider: "baseten"
})

console.log(result.text)
console.log("Provider:", result.provider)
console.log("Model:", result.model)

Streaming:

import { streamText } from "webinfer"

const { textStream } = await streamText({
  prompt: "Write a story about AI",
  provider: "baseten"
})

for await (const chunk of textStream) {
  process.stdout.write(chunk)
}