Skip to main content

Model Providers

The Model Providers page (/admin/model-providers) lets workspace administrators configure and manage AI model providers. Only admin users can access this page.

Model provider management in BasePeak.AIModel provider management in BasePeak.AI

Supported providersโ€‹

BasePeak.AI supports a wide range of model providers. EU-hosted providers managed by BasePeak come first โ€” they process your data exclusively in European data centers and are the recommended choice when data residency and GDPR compliance matter.

๐Ÿ‡ช๐Ÿ‡บ EU-hosted (managed by BasePeak)โ€‹

ProviderDescription
BasePeak Model RouterThe platform's default provider. Bundles several European model providers (including OpenHippo and Infercom) behind a single OpenAI-compatible API โ€” with load balancing and failover.
InfercomEU-hosted model inference.
OpenHippoEU-hosted open-model inference.
Data residency

With the EU-hosted providers, your requests and content never leave the European jurisdiction.

External providers (bring your own access)โ€‹

Connect leading commercial providers with your own credentials. These run outside the EU:

  • OpenAI
  • Anthropic
  • Azure OpenAI
  • Anthropic via AWS Bedrock
  • Google Gemini (Vertex AI)
  • xAI
  • DeepSeek
  • Groq
  • Voyage AI (embeddings)

Self-hostedโ€‹

Providers you run in your own environment:

  • Ollama
  • vLLM
  • KubeAI
  • LiteLLM
  • Generic OpenAI-compatible endpoint

The UI shows whether each provider has been configured. Configured providers display the number of available models and offer options to manage models or remove the provider.

Configuring a providerโ€‹

To add and configure a provider:

  1. Click Add Provider to open the provider picker
  2. Select the provider type and give the instance a display name
  3. Click Configure on the new instance
  4. Enter the required credentials (API key, endpoint URL, etc.)
  5. Save โ€” BasePeak.AI validates the credentials immediately

You can configure multiple providers, letting you pick the right provider and model for each use case. Read-only providers bootstrapped by the BasePeak platform (such as the managed default provider) cannot be reconfigured through the UI.

Viewing and managing modelsโ€‹

Once a provider is configured, open its Models view to manage the models it offers. For each model you can:

  • Activate or deactivate the model (controls availability to users)
  • Set the usage type to tell the platform how the model should be used:
Usage typeDescriptionUsed in
Language ModelText generation and tool callsAgents and tasks; selectable as an agent's primary model
Text EmbeddingConverts text into numerical vectorsKnowledge tool (RAG)
Image GenerationCreates images from text descriptionsImage generation tools
VisionAnalyses and processes visual contentImage vision tool
OtherDefault when no specific usage is selectedAvailable for all purposes

Use Refresh models from the provider action menu to pull the latest model list from the provider.

Activated models then appear in the model picker that users can open from within a conversation:

Model picker in a conversationModel picker in a conversation

Setting default modelsโ€‹

Click Set default models (top-right of the Model Providers page) to choose platform defaults for:

  • Language Model (Chat) โ€” primary conversational model
  • Language Model (Chat - Fast) โ€” optimised for quick responses
  • Text Embedding (Knowledge) โ€” used for knowledge base operations
  • Image Generation โ€” for creating images
  • Vision โ€” for image analysis

These defaults apply when a user or agent has not selected a specific model. After choosing the defaults, click Save Changes.