WebInfer

Groq

Ultra-fast inference with browser search

Fast
Fast & Cost-Effective
API

Configure Groq

Add your Groq API key in Settings

Go to Settings
Capabilities
chat
fast-inference
browser-search
Configuration Schema
Required and optional fields for configuring this provider
FieldTypeRequired
apiKey
password
Required
CLI Usage
For users running the daemon server locally or a self-hosted gateway

Add provider:

npx webinfer provider add groq --key YOUR_API_KEY

Test connection:

npx webinfer provider test groq

Get your API key from https://console.groq.com/

Programmatic Usage
Use Groq in your code with WebInfer

Basic usage:

import { generateText } from "webinfer"

// WebInfer automatically routes to the best available provider
const result = await generateText({
  prompt: "Write a haiku about programming"
})

console.log(result.text)

Specify Groq explicitly:

import { generateText } from "webinfer"

const result = await generateText({
  prompt: "Write a haiku about programming",
  provider: "groq"
})

console.log(result.text)
console.log("Provider:", result.provider)
console.log("Model:", result.model)

Streaming:

import { streamText } from "webinfer"

const { textStream } = await streamText({
  prompt: "Write a story about AI",
  provider: "groq"
})

for await (const chunk of textStream) {
  process.stdout.write(chunk)
}