Skip to main content

ModelProviders

Struct ModelProviders 

Source
pub struct ModelProviders {
Show 64 fields pub openai: HashMap<String, OpenAIModelProviderConfig>, pub azure: HashMap<String, AzureModelProviderConfig>, pub anthropic: HashMap<String, AnthropicModelProviderConfig>, pub moonshot: HashMap<String, MoonshotModelProviderConfig>, pub qwen: HashMap<String, QwenModelProviderConfig>, pub glm: HashMap<String, GlmModelProviderConfig>, pub minimax: HashMap<String, MinimaxModelProviderConfig>, pub zai: HashMap<String, ZaiModelProviderConfig>, pub doubao: HashMap<String, DoubaoModelProviderConfig>, pub yi: HashMap<String, YiModelProviderConfig>, pub hunyuan: HashMap<String, HunyuanModelProviderConfig>, pub qianfan: HashMap<String, QianfanModelProviderConfig>, pub baichuan: HashMap<String, BaichuanModelProviderConfig>, pub openrouter: HashMap<String, OpenRouterModelProviderConfig>, pub ollama: HashMap<String, OllamaModelProviderConfig>, pub gemini: HashMap<String, GeminiModelProviderConfig>, pub gemini_cli: HashMap<String, GeminiCliModelProviderConfig>, pub bedrock: HashMap<String, BedrockModelProviderConfig>, pub telnyx: HashMap<String, TelnyxModelProviderConfig>, pub together: HashMap<String, TogetherModelProviderConfig>, pub fireworks: HashMap<String, FireworksModelProviderConfig>, pub groq: HashMap<String, GroqModelProviderConfig>, pub mistral: HashMap<String, MistralModelProviderConfig>, pub deepseek: HashMap<String, DeepseekModelProviderConfig>, pub atomic_chat: HashMap<String, AtomicChatModelProviderConfig>, pub cohere: HashMap<String, CohereModelProviderConfig>, pub perplexity: HashMap<String, PerplexityModelProviderConfig>, pub xai: HashMap<String, XaiModelProviderConfig>, pub cerebras: HashMap<String, CerebrasModelProviderConfig>, pub sambanova: HashMap<String, SambanovaModelProviderConfig>, pub hyperbolic: HashMap<String, HyperbolicModelProviderConfig>, pub deepinfra: HashMap<String, DeepinfraModelProviderConfig>, pub huggingface: HashMap<String, HuggingfaceModelProviderConfig>, pub ai21: HashMap<String, Ai21ModelProviderConfig>, pub reka: HashMap<String, RekaModelProviderConfig>, pub baseten: HashMap<String, BasetenModelProviderConfig>, pub nscale: HashMap<String, NscaleModelProviderConfig>, pub anyscale: HashMap<String, AnyscaleModelProviderConfig>, pub nebius: HashMap<String, NebiusModelProviderConfig>, pub friendli: HashMap<String, FriendliModelProviderConfig>, pub stepfun: HashMap<String, StepfunModelProviderConfig>, pub aihubmix: HashMap<String, AihubmixModelProviderConfig>, pub siliconflow: HashMap<String, SiliconflowModelProviderConfig>, pub astrai: HashMap<String, AstraiModelProviderConfig>, pub avian: HashMap<String, AvianModelProviderConfig>, pub deepmyst: HashMap<String, DeepmystModelProviderConfig>, pub venice: HashMap<String, VeniceModelProviderConfig>, pub novita: HashMap<String, NovitaModelProviderConfig>, pub nvidia: HashMap<String, NvidiaModelProviderConfig>, pub vercel: HashMap<String, VercelModelProviderConfig>, pub cloudflare: HashMap<String, CloudflareModelProviderConfig>, pub ovh: HashMap<String, OvhModelProviderConfig>, pub copilot: HashMap<String, CopilotModelProviderConfig>, pub lmstudio: HashMap<String, LmstudioModelProviderConfig>, pub llamacpp: HashMap<String, LlamacppModelProviderConfig>, pub sglang: HashMap<String, SglangModelProviderConfig>, pub vllm: HashMap<String, VllmModelProviderConfig>, pub osaurus: HashMap<String, OsaurusModelProviderConfig>, pub litellm: HashMap<String, LitellmModelProviderConfig>, pub lepton: HashMap<String, LeptonModelProviderConfig>, pub synthetic: HashMap<String, SyntheticModelProviderConfig>, pub opencode: HashMap<String, OpencodeModelProviderConfig>, pub kilocli: HashMap<String, KiloCliModelProviderConfig>, pub custom: HashMap<String, CustomModelProviderConfig>,
}
Expand description

Typed model provider container — one slot per canonical model_provider type.

Replaces the HashMap<String, HashMap<String, ModelProviderConfig>> with a typed struct so each family’s per-alias map carries its own typed config (with the family’s *Endpoint enum and family-specific extras visible at the type level).

TOML shape is preserved byte-identical: each named field deserializes from the same [model_providers.<type>.<alias>] block as before.

Adding a new model_provider family means: define the typed config in schema.rs, then add one row to for_each_model_provider_slot! — every helper picks up the new slot automatically.

Fields§

§openai: HashMap<String, OpenAIModelProviderConfig>§azure: HashMap<String, AzureModelProviderConfig>§anthropic: HashMap<String, AnthropicModelProviderConfig>§moonshot: HashMap<String, MoonshotModelProviderConfig>§qwen: HashMap<String, QwenModelProviderConfig>§glm: HashMap<String, GlmModelProviderConfig>§minimax: HashMap<String, MinimaxModelProviderConfig>§zai: HashMap<String, ZaiModelProviderConfig>§doubao: HashMap<String, DoubaoModelProviderConfig>§yi: HashMap<String, YiModelProviderConfig>§hunyuan: HashMap<String, HunyuanModelProviderConfig>§qianfan: HashMap<String, QianfanModelProviderConfig>§baichuan: HashMap<String, BaichuanModelProviderConfig>§openrouter: HashMap<String, OpenRouterModelProviderConfig>§ollama: HashMap<String, OllamaModelProviderConfig>§gemini: HashMap<String, GeminiModelProviderConfig>§gemini_cli: HashMap<String, GeminiCliModelProviderConfig>§bedrock: HashMap<String, BedrockModelProviderConfig>§telnyx: HashMap<String, TelnyxModelProviderConfig>§together: HashMap<String, TogetherModelProviderConfig>§fireworks: HashMap<String, FireworksModelProviderConfig>§groq: HashMap<String, GroqModelProviderConfig>§mistral: HashMap<String, MistralModelProviderConfig>§deepseek: HashMap<String, DeepseekModelProviderConfig>§atomic_chat: HashMap<String, AtomicChatModelProviderConfig>§cohere: HashMap<String, CohereModelProviderConfig>§perplexity: HashMap<String, PerplexityModelProviderConfig>§xai: HashMap<String, XaiModelProviderConfig>§cerebras: HashMap<String, CerebrasModelProviderConfig>§sambanova: HashMap<String, SambanovaModelProviderConfig>§hyperbolic: HashMap<String, HyperbolicModelProviderConfig>§deepinfra: HashMap<String, DeepinfraModelProviderConfig>§huggingface: HashMap<String, HuggingfaceModelProviderConfig>§ai21: HashMap<String, Ai21ModelProviderConfig>§reka: HashMap<String, RekaModelProviderConfig>§baseten: HashMap<String, BasetenModelProviderConfig>§nscale: HashMap<String, NscaleModelProviderConfig>§anyscale: HashMap<String, AnyscaleModelProviderConfig>§nebius: HashMap<String, NebiusModelProviderConfig>§friendli: HashMap<String, FriendliModelProviderConfig>§stepfun: HashMap<String, StepfunModelProviderConfig>§aihubmix: HashMap<String, AihubmixModelProviderConfig>§siliconflow: HashMap<String, SiliconflowModelProviderConfig>§astrai: HashMap<String, AstraiModelProviderConfig>§avian: HashMap<String, AvianModelProviderConfig>§deepmyst: HashMap<String, DeepmystModelProviderConfig>§venice: HashMap<String, VeniceModelProviderConfig>§novita: HashMap<String, NovitaModelProviderConfig>§nvidia: HashMap<String, NvidiaModelProviderConfig>§vercel: HashMap<String, VercelModelProviderConfig>§cloudflare: HashMap<String, CloudflareModelProviderConfig>§ovh: HashMap<String, OvhModelProviderConfig>§copilot: HashMap<String, CopilotModelProviderConfig>§lmstudio: HashMap<String, LmstudioModelProviderConfig>§llamacpp: HashMap<String, LlamacppModelProviderConfig>§sglang: HashMap<String, SglangModelProviderConfig>§vllm: HashMap<String, VllmModelProviderConfig>§osaurus: HashMap<String, OsaurusModelProviderConfig>§litellm: HashMap<String, LitellmModelProviderConfig>§lepton: HashMap<String, LeptonModelProviderConfig>§synthetic: HashMap<String, SyntheticModelProviderConfig>§opencode: HashMap<String, OpencodeModelProviderConfig>§kilocli: HashMap<String, KiloCliModelProviderConfig>§custom: HashMap<String, CustomModelProviderConfig>

Implementations§

Source§

impl ModelProviders

Source

pub fn configurable_prefix() -> &'static str

Returns the #[prefix] value for this Configurable struct.

Source

pub fn secret_fields(&self) -> Vec<SecretFieldInfo>

Returns metadata about all #[secret] fields on this struct and nested children.

Source

pub fn secret_field_terminals() -> Vec<&'static str>

Static enumeration of every #[secret] field’s terminal name (snake_case, matching the on-disk TOML key) reachable from this type via #[nested] traversal. Unlike secret_fields(), this requires no instance — the per-struct codegen literals are joined at call time with recursive calls into the inner types’ own secret_field_terminals().

Used by the migration crate’s raw-TOML encrypt walker as the secret-key allowlist. prop_fields()-derived allowlists skip compound (non-Vec) #[secret] fields, so this method is the authoritative source.

Source

pub fn encrypt_secrets(&mut self, store: &SecretStore) -> Result<()>

Encrypt all secret fields in place using the provided store.

Source

pub fn decrypt_secrets(&mut self, store: &SecretStore) -> Result<()>

Decrypt all secret fields in place using the provided store.

Source

pub fn set_secret(&mut self, name: &str, value: String) -> Result<()>

Set a secret field by its full dotted name, dispatching to nested children.

Source

pub fn prop_fields(&self) -> Vec<PropFieldInfo>

Returns metadata about all property fields on this struct and nested children.

Source

pub fn get_prop(&self, name: &str) -> Result<String>

Get a property value by its full dotted name, returning it as a display string.

Source

pub fn set_prop(&mut self, name: &str, value_str: &str) -> Result<()>

Set a property value by its full dotted name, parsing from string.

Source

pub fn prop_is_secret(name: &str) -> bool

Check if a property name refers to a secret field (static, no instance needed).

Source

pub fn init_defaults(&mut self, prefix: Option<&str>) -> Vec<&'static str>

Instantiate None nested sections whose prefix matches. Returns the prefixes that were initialized.

Source

pub fn map_key_sections() -> Vec<MapKeySection>

Enumerate every map-keyed (HashMap<String, T>) and list-shaped (Vec<T>) section discoverable from this Configurable’s tree. The dashboard / CLI consume this to surface “+ Add” affordances without hardcoding the section list.

Source

pub fn nested_section_help(name: &str) -> Option<&'static str>

Help blurb for a #[nested] field on this struct, sourced from the field-level /// docstring. Returns None for unknown names so callers can fall through to a different lookup.

Source

pub fn get_map_keys(&self, section_path: &str) -> Option<Vec<String>>

Return the current alias keys at section_path, or None if the path doesn’t resolve to a map-keyed section in this tree.

Source

pub fn nested_option_entries(&self) -> Vec<NestedOptionEntry>

Snapshot of every #[nested] Option<T> field on this struct as (field_name, is_some) tuples, in declaration order.

field_name is the raw Rust ident (snake_case) — consumers can map to display names via their own table. The schema is the single source of truth: adding a new pub foo: Option<FooConfig> field with #[nested] surfaces here without touching any caller.

Source

pub fn create_map_key( &mut self, section_path: &str, map_key: &str, ) -> Result<bool, String>

Insert a default-valued entry under a map-keyed section, or append to a list-shaped one, with map_key as the new entry’s natural identifier (HashMap key for Map sections; identifier field for List sections).

Returns Ok(true) if a new entry was created, Ok(false) if the entry already existed (idempotent), or Err(reason) if the section path doesn’t resolve to a Map/List in this tree.

Source

pub fn delete_map_key( &mut self, section_path: &str, map_key: &str, ) -> Result<bool, String>

Remove the entry identified by map_key from the map-keyed section at section_path.

Returns Ok(true) if the entry existed and was removed, Ok(false) if it didn’t exist, or Err(reason) if the section path doesn’t resolve.

Source

pub fn rename_map_key( &mut self, section_path: &str, map_key: &str, new_key: &str, ) -> Result<bool, String>

Rename map_key to new_key within the map-keyed section at section_path, preserving the entry’s value.

Returns Ok(true) if renamed, Ok(false) if map_key didn’t exist, or Err(reason) if new_key already exists or the section path doesn’t resolve.

Source§

impl ModelProviders

Source

pub fn iter_entries( &self, ) -> impl Iterator<Item = (&'static str, &str, &ModelProviderConfig)>

Iterate every entry across every typed slot, yielding (provider_type, alias, &base) triples. Use this when consumer code needs to walk every model model_provider entry without caring about family.

Materializes through a Vec rather than chaining iterators directly: with ~60 typed slots the deeply-nested Chain<Chain<...>> type blows up rustc’s Freeze trait-resolution recursion limit. The collection cost is negligible (entries are sparse — most slots are empty in any real config). Returned as impl Iterator so call sites can chain .next(), .filter_map(), etc. without changes.

Source

pub fn iter_entries_mut( &mut self, ) -> impl Iterator<Item = (&'static str, &str, &mut ModelProviderConfig)>

Iterate every entry mutably across every typed slot.

Source

pub fn resolved_endpoint_uri( &self, family: &str, alias: &str, ) -> Option<&'static str>

Resolve the family-default endpoint URI for <family>.<alias>. Returns None when the family is single-endpoint, unknown, or the alias is missing. Dispatch is generated by for_each_model_provider_slot!, so adding a family without a FamilyEndpoint impl is a compile error.

Source

pub fn find(&self, family: &str, alias: &str) -> Option<&ModelProviderConfig>

Look up the shared base config for a given <provider_type>.<alias> pair. Returns None when the family isn’t recognized OR when the alias doesn’t exist in that family’s typed slot.

Source

pub fn ensure( &mut self, family: &str, alias: &str, ) -> Option<&mut ModelProviderConfig>

Get-or-create the shared base config for a <provider_type>.<alias> pair, returning a mutable reference. Used by tools that mutate generic baseline fields (model, temperature, api_key) without caring about the family’s specific extras. Returns None for unknown model_provider types.

Source

pub fn contains_model_provider_type(&self, family: &str) -> bool

True when family’s typed slot has at least one configured alias entry. Returns false for unknown families.

Source

pub fn aliases_of<'a>( &'a self, family: &str, ) -> Box<dyn Iterator<Item = &'a str> + 'a>

Iterate the alias keys for a given model_provider type. Returns an empty iterator for unknown model_provider types.

Source

pub fn remove_alias(&mut self, family: &str, alias: &str) -> bool

Remove the entry for <provider_type>.<alias>, returning whether it existed. Returns false for unknown families.

Source

pub fn is_empty(&self) -> bool

True when no slot has any entry.

Source

pub fn len(&self) -> usize

Total number of (provider_type, alias) entries across all slots.

Trait Implementations§

Source§

impl Clone for ModelProviders

Source§

fn clone(&self) -> ModelProviders

Returns a duplicate of the value. Read more
1.0.0 · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for ModelProviders

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl Default for ModelProviders

Source§

fn default() -> ModelProviders

Returns the “default value” for a type. Read more
Source§

impl<'de> Deserialize<'de> for ModelProviders

Source§

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>
where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer. Read more
Source§

impl JsonSchema for ModelProviders

Source§

fn schema_name() -> Cow<'static, str>

The name of the generated JSON Schema. Read more
Source§

fn schema_id() -> Cow<'static, str>

Returns a string that uniquely identifies the schema produced by this type. Read more
Source§

fn json_schema(generator: &mut SchemaGenerator) -> Schema

Generates a JSON Schema for this type. Read more
Source§

fn inline_schema() -> bool

Whether JSON Schemas generated for this type should be included directly in parent schemas, rather than being re-used where possible using the $ref keyword. Read more
Source§

impl MaskSecrets for ModelProviders

Source§

fn mask_secrets(&mut self)

Source§

fn restore_secrets_from(&mut self, current: &Self)

Source§

impl Serialize for ModelProviders

Source§

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>
where __S: Serializer,

Serialize this value into the given Serde serializer. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> DynClone for T
where T: Clone,

Source§

fn __clone_box(&self, _: Private) -> *mut ()

Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

§

impl<T> Instrument for T

§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided [Span], returning an Instrumented wrapper. Read more
§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self>

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
§

impl<T> PolicyExt for T
where T: ?Sized,

§

fn and<P, B, E>(self, other: P) -> And<T, P>
where T: Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns [Action::Follow] only if self and other return Action::Follow. Read more
§

fn or<P, B, E>(self, other: P) -> Or<T, P>
where T: Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns [Action::Follow] if either self or other returns Action::Follow. Read more
Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

§

fn vzip(self) -> V

§

impl<T> WithSubscriber for T

§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a [WithDispatch] wrapper. Read more
§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a [WithDispatch] wrapper. Read more
Source§

impl<T> DeserializeOwned for T
where T: for<'de> Deserialize<'de>,