Update LLM Configuration

PUT

/api/v2/organizations/llm-configs/{config_id}

Change the settings of one of your organization's LLM configurations, or enable or disable it.
Only the fields you send change; the others keep their values.

parameters replaces the stored provider settings as a whole. Whether users can pick the configuration for chat or voice is changed with PATCH on the same path, not here.

Requires the admin role in the organization.

Versions

2.1 (the default) accepts parameters, and the response includes parameters and user_options; 2.0 has neither.

Current Version:

2.1.1

Changelog:

2.1.1: Changing model_deployment re-links the shared model profile that serves it, and the response returns user_options.

2.1.0: Added parameters to the request and the response.

2.0.0: Initial version.

Request

Path Params

Header Params

Body Params

application/json

Examples

Responses

🟢200

application/json

The fields you sent were saved; the others kept their values. An empty body saves nothing and also returns 200.

Bodyapplication/json

🟠400

🟠403

🟠404

🔴500

🔴503

Request Example

Shell

JavaScript

Java

Swift

cURL

Replace the provider settingsDisable a configuration

curl --location --globoff --request PUT 'https:///api/v2/organizations/llm-configs/' \
--header 'Organization-Id;' \
--header 'Ocp-Apim-Subscription-Key: ' \
--header 'Authorization: Bearer ' \
--header 'Content-Type: application/json' \
--data '{
    "parameters": {
        "model": "claude-opus-4-8",
        "model_provider": "anthropic",
        "api_key": "<your-api-key>",
        "base_url": "https://<resource>.services.ai.azure.com/anthropic/",
        "thinking": {
            "type": "adaptive",
            "display": "omitted"
        },
        "max_tokens": 64000,
        "output_config": {
            "effort": "medium"
        }
    }
}'

Response Example

200 - Configuration updated

{
    "success": true,
    "message": "LLM configuration 'claude-opus-4-8' updated successfully",
    "data": {
        "id": 42,
        "organization_id": 1,
        "model_name": "claude-opus-4-8",
        "model_provider": "anthropic",
        "model_deployment": [
            "chat"
        ],
        "release_date": "2025-01-01",
        "temperature": 0.7,
        "top_p": 1,
        "max_tokens": 8096,
        "reasoning_effort": "medium",
        "type": "Anthropic",
        "context_length": 200000,
        "pricing": 0.015,
        "supports_function_calling": true,
        "supports_voice_calling": false,
        "is_reasoning_model": true,
        "is_enabled": true,
        "is_default": false,
        "is_default_voice": false,
        "tokens_per_minute": 40000,
        "requests_per_minute": 50,
        "parameters": {
            "model": "claude-opus-4-8",
            "model_provider": "anthropic",
            "api_key": "************",
            "base_url": "https://<resource>.services.ai.azure.com/anthropic/",
            "thinking": {
                "type": "adaptive",
                "display": "omitted"
            },
            "max_tokens": 64000,
            "output_config": {
                "effort": "medium"
            }
        },
        "user_options": {
            "effort": {
                "labels": [
                    "minimal",
                    "low",
                    "medium",
                    "high"
                ],
                "default": "medium"
            }
        }
    }
}

Toggle LLM Configuration Availability