Bring Your Own LLM
The RunWhen platform supports multiple pathways for securely integrating with Enterprise-managed Large Language Models (LLMs). These integrations are designed to give customers full control over their data, security posture, and access governance.
Recommended LLM Endpoint Options
Due to cost, latency and strong contractual terms re: enterprise data security, we strongly recommend the AzureOpenAI Service. (Note - We have found the data security terms for AzureOpenAI are materially stronger than OpenAI Enterprise licenses.) For teams primarily on AWS or GCP, our team can assist in provisioning a single-service Azure account for this.
If AzureOpenAI is organizationally difficult, RunWhen can host a single-tenant Azure subscription with a secured AzureOpenAI endpoint and make it available for your team. (Enterprise data does not transit RunWhen, and this maintains AzureOpenAI data security contractual guarantees.)
Alternative LLM Options
RunWhen functionality has been validated with the models below. Latency, quality and pricing may vary.
OpenAI Endpoint – OpenAI endpoint (various GPT models) with an OpenAI credentials.
OpenAI Endpoint via LiteLLM proxy – OpenAI endpoint (various GPT models) with deployment-specific credentials.
Google Cloud Vertex AI with Gemini – using customer-managed service accounts with restricted IAM roles.
Google Cloud Vertex AI with Llama4 – using customer-managed service accounts with restricted IAM roles.
Amazon Bedrock with Llama4 – roadmap
On-Prem Llama4 via vLLM Serving or LiteLLM proxys – Llama4 via LiteLLM or vLLM and customer-issued credentials.
Each integration pattern is tailored to enterprise requirements around compliance, data isolation, and access auditing.
Support and Guidance
Every enterprise environment is unique. To ensure the integration meets your organization’s compliance and security needs, please reach out to the RunWhen Support Team for:
Assistance with selecting the right integration model.
Guidance on Service Principal or IAM role setup.
Network and IP allowlisting requirements.
End-to-end validation and troubleshooting.
📩 Contact: support@runwhen.com