> ## Documentation Index
> Fetch the complete documentation index at: https://docs.scorecard.io/llms.txt
> Use this file to discover all available pages before exploring further.

# Custom LLM Providers

> Scorecard supports multiple AI providers through our AI proxy infrastructure, allowing you to easily configure and switch between different LLM services.

## Overview

Scorecard's AI proxy infrastructure provides seamless integration with all major AI providers, enabling you to configure multiple providers, switch between models effortlessly, and maintain consistent API calls across different services.

<Note>
  Configure your provider API keys in [organization settings](https://app.scorecard.io/settings) to get started with any of the supported providers below.
</Note>

## Supported AI Providers

Choose from our comprehensive selection of AI providers, each offering unique strengths and model capabilities:

<CardGroup cols={2}>
  <Card title="OpenAI" href="https://openai.com">
    <div className="flex flex-col items-center -mt-4">
      <div className="mb-4">
        <img className="hidden dark:block w-8 h-8 object-contain" src="https://mintcdn.com/scorecard-d65b5e8a/0O4tJIyktUcDdm0x/images/providers/openai.png?fit=max&auto=format&n=0O4tJIyktUcDdm0x&q=85&s=c75f6247e3220ca43512b6c3b361a541" alt="OpenAI logo" style={{filter: 'brightness(0) invert(1)'}} width="2021" height="2048" data-path="images/providers/openai.png" />

        <img className="block dark:hidden w-8 h-8 object-contain" src="https://mintcdn.com/scorecard-d65b5e8a/0O4tJIyktUcDdm0x/images/providers/openai.png?fit=max&auto=format&n=0O4tJIyktUcDdm0x&q=85&s=c75f6247e3220ca43512b6c3b361a541" alt="OpenAI logo" width="2021" height="2048" data-path="images/providers/openai.png" />
      </div>

      <p className="text-center">Access OpenAI language models for various use cases.</p>
    </div>
  </Card>

  <Card title="Anthropic" href="https://www.anthropic.com">
    <div className="flex flex-col items-center -mt-4">
      <div className="mb-4">
        <img className="hidden dark:block w-8 h-8 object-contain" src="https://mintcdn.com/scorecard-d65b5e8a/0O4tJIyktUcDdm0x/images/providers/anthropic.png?fit=max&auto=format&n=0O4tJIyktUcDdm0x&q=85&s=8f21894a6c63253133d4136266b03e42" alt="Anthropic logo" style={{filter: 'brightness(0) invert(1)'}} width="1875" height="1287" data-path="images/providers/anthropic.png" />

        <img className="block dark:hidden w-8 h-8 object-contain" src="https://mintcdn.com/scorecard-d65b5e8a/0O4tJIyktUcDdm0x/images/providers/anthropic.png?fit=max&auto=format&n=0O4tJIyktUcDdm0x&q=85&s=8f21894a6c63253133d4136266b03e42" alt="Anthropic logo" width="1875" height="1287" data-path="images/providers/anthropic.png" />
      </div>

      <p className="text-center">Integrate Claude models for advanced reasoning, analysis, and creative tasks.</p>
    </div>
  </Card>

  <Card title="Google" href="https://ai.google.dev">
    <div className="flex flex-col items-center -mt-4">
      <div className="mb-4">
        <img className="w-8 h-8 object-contain" src="https://mintcdn.com/scorecard-d65b5e8a/0O4tJIyktUcDdm0x/images/providers/google.png?fit=max&auto=format&n=0O4tJIyktUcDdm0x&q=85&s=66e5d49d877df4b6898af44afc209b03" alt="Google logo" width="1024" height="1024" data-path="images/providers/google.png" />
      </div>

      <p className="text-center">Utilize Gemini models and other Google AI services.</p>
    </div>
  </Card>

  <Card title="Vertex AI" href="https://cloud.google.com/vertex-ai">
    <div className="flex flex-col items-center -mt-4">
      <div className="mb-4">
        <img className="w-8 h-8 object-contain" src="https://mintcdn.com/scorecard-d65b5e8a/0O4tJIyktUcDdm0x/images/providers/google.png?fit=max&auto=format&n=0O4tJIyktUcDdm0x&q=85&s=66e5d49d877df4b6898af44afc209b03" alt="Google logo" width="1024" height="1024" data-path="images/providers/google.png" />
      </div>

      <p className="text-center">Access enterprise-grade AI models through Google Cloud's Vertex AI platform.</p>
    </div>
  </Card>

  <Card title="Groq" href="https://groq.com">
    <div className="flex flex-col items-center -mt-4">
      <div className="mb-4">
        <img className="hidden dark:block w-8 h-8 object-contain" src="https://mintcdn.com/scorecard-d65b5e8a/0O4tJIyktUcDdm0x/images/providers/groq.png?fit=max&auto=format&n=0O4tJIyktUcDdm0x&q=85&s=9eb77525b10b5b42b1686a0e534932e4" alt="Groq logo" style={{filter: 'brightness(0) invert(1)'}} width="172" height="250" data-path="images/providers/groq.png" />

        <img className="block dark:hidden w-8 h-8 object-contain" src="https://mintcdn.com/scorecard-d65b5e8a/0O4tJIyktUcDdm0x/images/providers/groq.png?fit=max&auto=format&n=0O4tJIyktUcDdm0x&q=85&s=9eb77525b10b5b42b1686a0e534932e4" alt="Groq logo" width="172" height="250" data-path="images/providers/groq.png" />
      </div>

      <p className="text-center">Ultra-high-speed inference for supported models with exceptional performance and low latency.</p>
    </div>
  </Card>

  <Card title="AWS Bedrock" href="https://aws.amazon.com/bedrock/">
    <div className="flex flex-col items-center -mt-4">
      <div className="mb-4">
        <img className="w-8 h-8 object-contain" src="https://mintcdn.com/scorecard-d65b5e8a/0O4tJIyktUcDdm0x/images/providers/aws.png?fit=max&auto=format&n=0O4tJIyktUcDdm0x&q=85&s=eecc754b5876757da90366c00473b20e" alt="AWS logo" width="1024" height="1024" data-path="images/providers/aws.png" />
      </div>

      <p className="text-center">Access Amazon's managed AI services with enterprise-grade security and compliance.</p>
    </div>
  </Card>
</CardGroup>

## Extended Model Access

Through our integrated providers, you gain access to an even broader ecosystem of cutting-edge models:

<Tabs>
  <Tab title="Via Groq">
    Access additional high-performance models through Groq's lightning-fast inference:

    <CardGroup cols={3}>
      <Card>
        <div className="flex items-center">
          <img className="w-5 h-5 mr-2" src="https://mintcdn.com/scorecard-d65b5e8a/0O4tJIyktUcDdm0x/images/providers/mistral.png?fit=max&auto=format&n=0O4tJIyktUcDdm0x&q=85&s=e7672bc5499ad6748060e67f7ad61a94" alt="Mistral logo" width="800" height="728" data-path="images/providers/mistral.png" />

          <a href="https://mistral.ai" target="_blank" className="font-medium hover:underline">Mistral AI</a>
        </div>

        <p className="text-sm mt-1">Efficient multilingual models</p>
      </Card>

      <Card>
        <div className="flex items-center">
          <img className="w-5 h-5 mr-2" src="https://mintcdn.com/scorecard-d65b5e8a/0O4tJIyktUcDdm0x/images/providers/meta.png?fit=max&auto=format&n=0O4tJIyktUcDdm0x&q=85&s=2c279839d76d57f791d1cf7045823954" alt="Meta logo" width="1000" height="1000" data-path="images/providers/meta.png" />

          <a href="https://ai.meta.com" target="_blank" className="font-medium hover:underline">Meta</a>
        </div>

        <p className="text-sm mt-1">Open-source language models</p>
      </Card>

      <Card>
        <div className="flex items-center">
          <img className="w-5 h-5 mr-2" src="https://mintcdn.com/scorecard-d65b5e8a/0O4tJIyktUcDdm0x/images/providers/cohere.jpeg?fit=max&auto=format&n=0O4tJIyktUcDdm0x&q=85&s=d8ad06736a0e36450148dd1619b6bfa6" alt="Cohere logo" width="400" height="400" data-path="images/providers/cohere.jpeg" />

          <a href="https://cohere.com" target="_blank" className="font-medium hover:underline">Cohere</a>
        </div>

        <p className="text-sm mt-1">Text generation and embeddings</p>
      </Card>
    </CardGroup>
  </Tab>

  <Tab title="Via AWS Bedrock">
    AWS Bedrock provides managed access to foundation models from multiple providers:

    <CardGroup cols={2}>
      <Card>
        <div className="flex items-center">
          <img className="block dark:hidden w-5 h-5 mr-2" src="https://mintcdn.com/scorecard-d65b5e8a/0O4tJIyktUcDdm0x/images/providers/anthropic.png?fit=max&auto=format&n=0O4tJIyktUcDdm0x&q=85&s=8f21894a6c63253133d4136266b03e42" alt="Anthropic logo" width="1875" height="1287" data-path="images/providers/anthropic.png" />

          <img className="hidden dark:block w-5 h-5 mr-2" src="https://mintcdn.com/scorecard-d65b5e8a/0O4tJIyktUcDdm0x/images/providers/anthropic.png?fit=max&auto=format&n=0O4tJIyktUcDdm0x&q=85&s=8f21894a6c63253133d4136266b03e42" alt="Anthropic logo" style={{filter: 'invert(1)'}} width="1875" height="1287" data-path="images/providers/anthropic.png" />

          <a href="https://www.anthropic.com" target="_blank" className="font-medium hover:underline">Anthropic</a>
        </div>

        <p className="text-sm mt-1">Advanced reasoning and analysis models</p>
      </Card>

      <Card>
        <div className="flex items-center">
          <img className="w-5 h-5 mr-2" src="https://mintcdn.com/scorecard-d65b5e8a/0O4tJIyktUcDdm0x/images/providers/cohere.jpeg?fit=max&auto=format&n=0O4tJIyktUcDdm0x&q=85&s=d8ad06736a0e36450148dd1619b6bfa6" alt="Cohere logo" width="400" height="400" data-path="images/providers/cohere.jpeg" />

          <a href="https://cohere.com" target="_blank" className="font-medium hover:underline">Cohere</a>
        </div>

        <p className="text-sm mt-1">Text generation and embeddings</p>
      </Card>

      <Card>
        <div className="flex items-center">
          <img className="w-5 h-5 mr-2" src="https://mintcdn.com/scorecard-d65b5e8a/0O4tJIyktUcDdm0x/images/providers/meta.png?fit=max&auto=format&n=0O4tJIyktUcDdm0x&q=85&s=2c279839d76d57f791d1cf7045823954" alt="Meta logo" width="1000" height="1000" data-path="images/providers/meta.png" />

          <a href="https://ai.meta.com" target="_blank" className="font-medium hover:underline">Meta</a>
        </div>

        <p className="text-sm mt-1">Open-source language models</p>
      </Card>

      <Card>
        <div className="flex items-center">
          <img className="w-5 h-5 mr-2" src="https://mintcdn.com/scorecard-d65b5e8a/0O4tJIyktUcDdm0x/images/providers/mistral.png?fit=max&auto=format&n=0O4tJIyktUcDdm0x&q=85&s=e7672bc5499ad6748060e67f7ad61a94" alt="Mistral logo" width="800" height="728" data-path="images/providers/mistral.png" />

          <a href="https://mistral.ai" target="_blank" className="font-medium hover:underline">Mistral AI</a>
        </div>

        <p className="text-sm mt-1">Efficient multilingual models</p>
      </Card>
    </CardGroup>
  </Tab>

  <Tab title="Via Google Vertex AI">
    Google Vertex AI provides enterprise-grade access to Google's AI models and third-party models:

    <CardGroup cols={2}>
      <Card>
        <div className="flex items-center">
          <img className="w-5 h-5 mr-2" src="https://mintcdn.com/scorecard-d65b5e8a/0O4tJIyktUcDdm0x/images/providers/google.png?fit=max&auto=format&n=0O4tJIyktUcDdm0x&q=85&s=66e5d49d877df4b6898af44afc209b03" alt="Google logo" width="1024" height="1024" data-path="images/providers/google.png" />

          <a href="https://ai.google.dev" target="_blank" className="font-medium hover:underline">Google AI</a>
        </div>

        <p className="text-sm mt-1">Gemini and PaLM models</p>
      </Card>

      <Card>
        <div className="flex items-center">
          <img className="block dark:hidden w-5 h-5 mr-2" src="https://mintcdn.com/scorecard-d65b5e8a/0O4tJIyktUcDdm0x/images/providers/anthropic.png?fit=max&auto=format&n=0O4tJIyktUcDdm0x&q=85&s=8f21894a6c63253133d4136266b03e42" alt="Anthropic logo" width="1875" height="1287" data-path="images/providers/anthropic.png" />

          <img className="hidden dark:block w-5 h-5 mr-2" src="https://mintcdn.com/scorecard-d65b5e8a/0O4tJIyktUcDdm0x/images/providers/anthropic.png?fit=max&auto=format&n=0O4tJIyktUcDdm0x&q=85&s=8f21894a6c63253133d4136266b03e42" alt="Anthropic logo" style={{filter: 'invert(1)'}} width="1875" height="1287" data-path="images/providers/anthropic.png" />

          <a href="https://www.anthropic.com" target="_blank" className="font-medium hover:underline">Anthropic</a>
        </div>

        <p className="text-sm mt-1">Claude models via Vertex AI</p>
      </Card>

      <Card>
        <div className="flex items-center">
          <img className="w-5 h-5 mr-2" src="https://mintcdn.com/scorecard-d65b5e8a/0O4tJIyktUcDdm0x/images/providers/meta.png?fit=max&auto=format&n=0O4tJIyktUcDdm0x&q=85&s=2c279839d76d57f791d1cf7045823954" alt="Meta logo" width="1000" height="1000" data-path="images/providers/meta.png" />

          <a href="https://ai.meta.com" target="_blank" className="font-medium hover:underline">Meta</a>
        </div>

        <p className="text-sm mt-1">Llama models via Vertex AI</p>
      </Card>

      <Card>
        <div className="flex items-center">
          <img className="w-5 h-5 mr-2" src="https://mintcdn.com/scorecard-d65b5e8a/0O4tJIyktUcDdm0x/images/providers/mistral.png?fit=max&auto=format&n=0O4tJIyktUcDdm0x&q=85&s=e7672bc5499ad6748060e67f7ad61a94" alt="Mistral logo" width="800" height="728" data-path="images/providers/mistral.png" />

          <a href="https://mistral.ai" target="_blank" className="font-medium hover:underline">Mistral AI</a>
        </div>

        <p className="text-sm mt-1">Mistral models via Vertex AI</p>
      </Card>
    </CardGroup>
  </Tab>
</Tabs>

## Key Benefits

<AccordionGroup>
  <Accordion title="Easy Provider Management">
    Configure multiple AI providers from a single interface using standardized API key management. No need to handle different authentication methods or API formats.
  </Accordion>

  <Accordion title="Seamless Model Switching">
    Switch between different AI models and providers without changing your implementation. Test and compare models effortlessly to find the best fit for your use case.
  </Accordion>

  <Accordion title="Unified Integration">
    Use consistent API calls regardless of the underlying AI provider through our proxy layer. Your code remains clean and provider-agnostic.
  </Accordion>

  <Accordion title="Cost Optimization">
    Compare costs across providers and models to optimize your AI spend. Easily switch to more cost-effective options as they become available.
  </Accordion>
</AccordionGroup>

## Getting Started

<Steps>
  <Step title="Add Provider Credentials">
    Navigate to your [organization settings](https://app.scorecard.io/settings) and add API keys for your desired providers.
  </Step>

  <Step title="Create or Update Prompts">
    When creating [prompts](/features/prompts), select from any of the available models across all configured providers.
  </Step>

  <Step title="Test and Compare">
    Use Scorecard's [A/B comparison features](/features/a-b-comparison) to evaluate performance across different providers and models.
  </Step>
</Steps>