跳转到主要内容
RAIL Score integrates with major LLM providers and observability tools. Provider wrappers add automatic RAIL scoring to every LLM response without changing your call logic.

LLM providers

OpenAI

RAILOpenAI - wraps GPT-4o, GPT-4o-mini, and all OpenAI chat models.

Anthropic

RAILAnthropic - wraps Claude 3.5, Claude 3, and all Anthropic models.

Google Gemini

RAILGemini - wraps Gemini 1.5 Pro/Flash and Vertex AI models.

Observability

Langfuse

Log RAIL scores alongside LLM traces in Langfuse.

LiteLLM

RAILGuardrail - RAIL as a LiteLLM guardrail.

OpenTelemetry

Export RAIL scores as OTEL spans.

Installation

Install just the providers you need:
pip install "rail-score-sdk[openai]"       # OpenAI
pip install "rail-score-sdk[anthropic]"    # Anthropic
pip install "rail-score-sdk[google]"       # Gemini
pip install "rail-score-sdk[litellm]"      # LiteLLM
pip install "rail-score-sdk[integrations]" # All LLM providers
For JavaScript:
npm install @responsible-ai-labs/rail-score openai          # + OpenAI
npm install @responsible-ai-labs/rail-score @anthropic-ai/sdk  # + Anthropic
npm install @responsible-ai-labs/rail-score @google/generative-ai  # + Gemini