Skip to content

groq ¶

Groq LLM provider (OpenAI-compatible chat endpoint).

Classes¶

fastvideo.entrypoints.streaming.prompt.providers.groq.GroqProvider `dataclass` ¶

GroqProvider(api_key: str | None = None, base_url: str = _DEFAULT_BASE_URL, name: str = 'groq')

Groq inference adapter.

Identical wire format to :class:CerebrasProvider; both go through :func:complete_openai_compatible. The two providers differ only in base URL, env var, and model id conventions.

Functions:¶