Overview

This guide explains how to configure Anthropic to work with Pay-i in both Proxy and Ingest modes. Anthropic is a supported Provider with several Resources that Pay-i can track.

SDK Support

The examples in this guide use the Pay-i Python SDK, which provides comprehensive support for Anthropic integration. If you're using a different programming language, you can utilize the Pay-i OpenAPI specification to generate a client SDK for your language of choice. The core concepts remain the same, though the exact implementation details may vary depending on the language and client library used.

Configuration Helper

Pay-i provides an Anthropic URL helper in payi.lib.helpers to make Anthropic setup easier:

Helper Function	Description
`payi_anthropic_url()`	Generates the correct proxy URL for Anthropic

Using Pay-i as a Proxy

For Anthropic, use the payi_anthropic_url() helper:

import os
import anthropic
from payi.lib.helpers import payi_anthropic_url

# Read API keys from environment variables
payi_key = os.getenv("PAYI_API_KEY", "YOUR_PAYI_API_KEY")
anthropic_key = os.getenv("ANTHROPIC_API_KEY", "YOUR_ANTHROPIC_API_KEY")

# Configure Anthropic client to use Pay-i as a proxy
client = anthropic.Anthropic(
    api_key=anthropic_key,
    base_url=payi_anthropic_url(),  # Use Pay-i's URL as the base
    default_headers={"xProxy-api-key": payi_key}  # Authenticate with Pay-i
)

# Use the client normally
message = client.messages.create(
    model="claude-2",
    max_tokens=1000,
    messages=[{"role": "user", "content": "Hello, how are you?"}]
)

Ingesting Metrics into Pay-i

In Ingest mode, configure your Anthropic client normally:

import os
import anthropic
from payi.lib.instrument import ingest
from payi.lib.helpers import create_headers

# Configure with direct Anthropic access
anthropic_key = os.getenv("ANTHROPIC_API_KEY", "YOUR_ANTHROPIC_API_KEY")
client = anthropic.Anthropic(api_key=anthropic_key)

# Use the decorator to track usage
@ingest(request_tags=['anthropic'], use_case_name='claude_example')
def claude_example():
    message = client.messages.create(
        model="claude-2",
        max_tokens=1000,
        messages=[{"role": "user", "content": "Hello, how are you?"}],
        headers=create_headers(
            user_id="user123",
            limit_ids=['anthropic_budget']
        )
    )
    return message.content[0].text

Advanced Configuration

Custom Base URLs

If you need to specify a custom base URL for private deployments or enterprise configurations:

from payi.lib.helpers import payi_anthropic_url

# Use a custom base URL (e.g., for private deployments)
custom_url = payi_anthropic_url(payi_base_url="https://custom.payi.domain.com")

Connection Pooling

For high-throughput applications, you may want to configure connection pooling:

import anthropic
import httpx
from payi.lib.helpers import payi_anthropic_url

# Configure with httpx transport for connection pooling
transport = httpx.HTTPTransport(limits=httpx.Limits(max_connections=100))
client = anthropic.Anthropic(
    api_key="your-key",
    base_url=payi_anthropic_url(),
    default_headers={"xProxy-api-key": "your-payi-key"},
    http_client=httpx.Client(transport=transport)
)

Timeouts

For operations that might take longer, consider configuring appropriate timeouts:

import anthropic
import httpx
from payi.lib.helpers import payi_anthropic_url

# Configure with longer timeouts for large requests
timeout = httpx.Timeout(timeout=60.0)  # 60 seconds
client = anthropic.Anthropic(
    api_key="your-key",
    base_url=payi_anthropic_url(),
    default_headers={"xProxy-api-key": "your-payi-key"},
    http_client=httpx.Client(timeout=timeout)
)

Anthropic Provider Configuration