External Models

​

Overview

​

Manage Connected Models

​

View Models

• Go to Models → External Models to see all connected models.

​

Manage Connections

​

Add a Model via Easy Integration

​

Standard Providers (OpenAI, Anthropic, Google, Cohere)

1. Go to Models → External Models → Add a model.
2. Select Easy Integration → click Next.
3. Choose your provider → click Next.
4. Select a model from the supported list.
5. Enter a Connection name and your API key.
6. Click Confirm.

​

Amazon Bedrock

1. Go to Models → External Models → Add a model.
2. Select Easy Integration → AWS Bedrock → Next.
3. Configure credentials and model details:

4. Configure model settings using Default or Existing Provider Structures.
5. Click Confirm.

​

Vertex AI

• New users: Use the express mode setup to generate an API key automatically, then manage keys under APIs & Services > Credentials.
• Existing users: Enable the Vertex AI API, create a service account (vertex-ai-runner) with the Vertex AI Platform Express User role, create an API key linked to that service account under APIs & Services > Credentials, and store the key securely.

1. Go to Models → External Models → Add a model.
2. Select Easy Integration → Vertex AI → Next.
3. Choose a configuration method:

​

Microsoft Foundry

1. Go to Models → External Models → Add a model.
2. Select Easy Integration → Microsoft Foundry → Next.
3. Choose an authentication method:

1. In the Azure Portal, go to App registrations → + New registration. Enter a name, select account type, and click Register.
2. Copy the Application (Client) ID and Directory (Tenant) ID from the Overview page.
3. Go to Certificates & secrets → + New client secret. Set an expiry and copy the Value immediately.
4. In your resource group, go to Access control (IAM) → Add role assignment. Assign a role (e.g., Contributor) and select your registered app.
5. Click Configure Service Principal in the Platform, enter a Connection name, and fill in Tenant ID, Application (Client) ID, Client Secret, and Subscription ID. Click Test, then Save.
6. Configure model settings under Model configurations. Enable the features your model supports:

Note: Tool calling must be enabled for the model to work in Agentic Apps.

5. Click Save as draft to store without activating, or Confirm to finalize.

​

Add a Model via API Integration

Note: For Agentic Apps compatibility, custom models must support tool calling and follow OpenAI or Anthropic request/response structures.

​

Steps

1. Go to Models → External Models → Add a model.
2. Select Custom Integration → click Next.
3. Enter basic configuration:

4. Configure model settings using Default or Existing Provider Structures.
5. Click Confirm

​

Model Configuration Modes

​

Default Mode

{
  "model": "your-model-name",
  "messages": [
    {"role": "system", "content": "{{system.prompt}}"},
    {"role": "user", "content": "{{prompt}}"}
  ],
  "max_tokens": 1000,
  "temperature": 0.7
}

​

Existing Provider Structures Mode

Warning: Enabling unsupported features may cause unexpected behavior.

​

Troubleshooting