OptionalapiOptionalbaseOptionaldefaultmax_tokens when the request sets none. Default: omit (provider default).
OptionaldefaultUsed when the request names no model and discovery found none.
OptionalfetchCustom fetch (proxy agent, tracing, tests).
OptionalheadersSent on every request, after the provider's own headers.
OptionalmodelHow long (ms) a successful model listing is reused before discoverModels() fetches again. Default 300000; 0 disables.
OptionalmodelKeep only these ids from GET /models. Default: keep all.
OptionalmodelsSeed the supported-model list so no discovery call is needed.
OptionalpresetA shipped host (groq, openrouter, ...): fills id, name, baseURL, apiKeyEnv and requireApiKey.
OptionalstreamDefault idle timeout (ms) for this provider's streams.
OptionalstreamSend stream_options: { include_usage: true } on streams. Default true.
OptionaltimeoutDefault whole-request timeout (ms) for this provider's JSON calls.
Origin, with or without
/v1(https://api.groq.com/openai/v1,http://localhost:1234).