Enable Python Inference in Settings
Run powerful Python-based AI models locally through the WebInfer Python Inference Engine. Currently supports Stable Audio Open 1.0 for generating up to 47 seconds of high-quality stereo audio. Requires running the Python server separately.
| Field | Type | Required | Description |
|---|---|---|---|
| baseUrl | url | Optional | URL of the Python inference server |
Add provider:
npx webinfer provider add python-inferenceTest connection:
npx webinfer provider test python-inferenceBasic usage:
import { generateText } from "webinfer"
// WebInfer automatically routes to the best available provider
const result = await generateText({
prompt: "Write a haiku about programming"
})
console.log(result.text)Specify Python Inference explicitly:
import { generateText } from "webinfer"
const result = await generateText({
prompt: "Write a haiku about programming",
provider: "python-inference"
})
console.log(result.text)
console.log("Provider:", result.provider)
console.log("Model:", result.model)Streaming:
import { streamText } from "webinfer"
const { textStream } = await streamText({
prompt: "Write a story about AI",
provider: "python-inference"
})
for await (const chunk of textStream) {
process.stdout.write(chunk)
}