openinference-instrumentation-anthropic (original) (raw)

Project description

Python autoinstrumentation library for the Anthropic package

This package implements the following Anthropic clients:

These traces are fully OpenTelemetry compatible and can be sent to an OpenTelemetry collector for viewing, such as Arize phoenix.

Installation

pip install openinference-instrumentation-anthropic

Quickstart

Through your terminal, install required packages.

pip install openinference-instrumentation-anthropic anthropic arize-phoenix opentelemetry-sdk opentelemetry-exporter-otlp

You can start Phoenix with the following terminal command:

python -m phoenix.server.main serve

By default, Phoenix listens on http://localhost:6006. You can visit the app via a browser at the same address. (Phoenix does not send data over the internet. It only operates locally on your machine.)

Try the following code in a Python file.

  1. Set up AnthropicInstrumentor to trace your application and sends the traces to Phoenix.
  2. Then, set your Anthropic API key as an environment variable.
  3. Lastly, create a Anthropic client, make a request, then go see your results in Phoenix at http://localhost:6006!

import os from anthropic import Anthropic from openinference.instrumentation.anthropic import AnthropicInstrumentor from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter from opentelemetry.sdk import trace as trace_sdk from opentelemetry.sdk.trace.export import SimpleSpanProcessor

Configure AnthropicInstrumentor with Phoenix endpoint

endpoint = "http://127.0.0.1:6006/v1/traces" tracer_provider = trace_sdk.TracerProvider() tracer_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint)))

AnthropicInstrumentor().instrument(tracer_provider=tracer_provider)

os.environ["ANTHROPIC_API_KEY"] = "YOUR_KEY_HERE"

client = Anthropic()

response = client.messages.create( max_tokens=1024, messages=[ { "role": "user", "content": "Tell me about the history of Iceland!", } ], model="claude-3-opus-20240229", ) print(response)

Now, on the Phoenix UI on your browser, you should see the traces from your Anthropic application. Click on a trace, then the "Attributes" tab will provide you with in-depth information regarding execution!

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Built Distribution

File details

Details for the file openinference_instrumentation_anthropic-0.1.18.tar.gz.

File metadata

File hashes

Hashes for openinference_instrumentation_anthropic-0.1.18.tar.gz | Algorithm | Hash digest | | | ----------- | ---------------------------------------------------------------- | | | SHA256 | 0a4cb556235dbcf8003e41204841b35be17e4e240ba5436218f5f837f36b0733 | | | MD5 | a073b43d587e104900da097898d9de74 | | | BLAKE2b-256 | 344f66ff7cd9f7d60fde67759fca05c53053a02ea654203354bf7ee5d5dca1d4 | |

See more details on using hashes here.

File details

Details for the file openinference_instrumentation_anthropic-0.1.18-py3-none-any.whl.

File metadata

File hashes

Hashes for openinference_instrumentation_anthropic-0.1.18-py3-none-any.whl | Algorithm | Hash digest | | | ----------- | ---------------------------------------------------------------- | | | SHA256 | c0aeb5b6fdfecc308b1e286ff66dd69d23371b999a545590811de14142716904 | | | MD5 | 1443eb0fd85452164e2ff41de3d1789f | | | BLAKE2b-256 | e3362ab55c22e17f1b426e4205fdb82925e69a22dd34bd2918e72254d5df3237 | |

See more details on using hashes here.