Features
Custom LLM Providers
Scorecard supports multiple AI providers through our AI proxy infrastructure, allowing you to easily configure and switch between different LLM services.
Overview
Scorecard’s AI proxy infrastructure provides seamless integration with all major AI providers, enabling you to configure multiple providers, switch between models effortlessly, and maintain consistent API calls across different services.Configure your provider API keys in organization settings to get started with any of the supported providers below.
Supported AI Providers
Choose from our comprehensive selection of AI providers, each offering unique strengths and model capabilities:OpenAI
Access OpenAI language models for various use cases.
Anthropic
Integrate Claude models for advanced reasoning, analysis, and creative tasks.
Utilize Gemini models and other Google AI services.
Groq
Ultra-high-speed inference for supported models with exceptional performance and low latency.
AWS Bedrock
Access Amazon’s managed AI services with enterprise-grade security and compliance.
Extended Model Access
Through our integrated providers, you gain access to an even broader ecosystem of cutting-edge models:Access additional high-performance models through Groq’s lightning-fast inference:
Efficient multilingual models
Open-source language models
Text generation and embeddings
Key Benefits
Easy Provider Management
Easy Provider Management
Configure multiple AI providers from a single interface using standardized API key management. No need to handle different authentication methods or API formats.
Seamless Model Switching
Seamless Model Switching
Switch between different AI models and providers without changing your implementation. Test and compare models effortlessly to find the best fit for your use case.
Unified Integration
Unified Integration
Use consistent API calls regardless of the underlying AI provider through our proxy layer. Your code remains clean and provider-agnostic.
Cost Optimization
Cost Optimization
Compare costs across providers and models to optimize your AI spend. Easily switch to more cost-effective options as they become available.
Getting Started
1
Add Provider Credentials
Navigate to your organization settings and add API keys for your desired providers.
2
3
Test and Compare
Use Scorecard’s A/B comparison features to evaluate performance across different providers and models.