Start free

LLM providers

Configuring external LLM providers and their model registries.

LLM providers are the AI services that power the research, synthesis, scoring, and outreach generation in Client Path. You configure them in Settings > LLM providers. Admin or owner role is required.

Supported provider kinds

KindDescription
OpenAI-compatibleAny API following the OpenAI chat completions format (OpenAI, Together AI, Groq, etc.)
AnthropicAnthropic's Claude models via their native API
Vercel AI GatewayRoute requests through Vercel's AI gateway for multi-provider load balancing
OllamaSelf-hosted models via the Ollama runtime
AWS BedrockModels via Amazon Bedrock
Azure OpenAIOpenAI models deployed on Azure

Adding a provider

  1. Go to Settings > LLM providers.
  2. Click Add provider.
  3. Select the provider kind.
  4. Enter a name (for your own reference).
  5. Enter the API key. Keys are encrypted at rest and shown only as the last four characters after saving.
  6. For OpenAI-compatible providers, enter the base URL.
  7. Add at least one model to the provider's model registry. Each model needs a model ID (the identifier the API uses, for example gpt-4o) and a display name.
  8. Click Save.

The provider is now available for use in LLM routing.

The provider editor form showing kind selector, name field, API key field, and model registry table

Data residency

Some providers process your prompts outside the country or region where your data is hosted. When you add a provider, you are asked to acknowledge data residency implications. This acknowledgement is logged with the timestamp and your user identity.

API key security

API keys are encrypted before storage. The application never logs the full key. You can rotate the key at any time by editing the provider and entering a new value.

Default provider

You can mark one provider as the default. The default provider is used when no routing rule specifically assigns a task to a different provider.

Archiving a provider

To remove a provider without deleting its audit history, archive it. Archived providers are excluded from routing but their historical usage data is retained.

See also: LLM routing, LLM audit.