# openinference-instrumentation-litellm

**Python · Instrumentation**

OpenInference liteLLM Instrumentation

- **Module**: `openinference.instrumentation.litellm`
- **Version**: 0.1.59
- **Python**: >=3.10, <3.15

[PyPI](https://pypi.org/project/openinference-instrumentation-litellm/) · [README](https://github.com/Arize-ai/openinference/blob/main/python/instrumentation/openinference-instrumentation-litellm/README.md) · [Source](https://github.com/Arize-ai/openinference/tree/main/python/instrumentation/openinference-instrumentation-litellm)

## Install

```sh
pip install openinference-instrumentation-litellm
```

## Usage

Instrument once, at startup, before the library is used. The [`LiteLLMInstrumentor`](https://openinf.dev/python/openinference-instrumentation-litellm.html.md#openinference.instrumentation.litellm.LiteLLMInstrumentor) reference below lists the options.

```python
from opentelemetry.sdk.trace import TracerProvider
from openinference.instrumentation import TraceConfig
from openinference.instrumentation.litellm import LiteLLMInstrumentor

tracer_provider = TracerProvider()
# ...add a span processor that exports to Phoenix or any OTLP backend.

LiteLLMInstrumentor().instrument(
    tracer_provider=tracer_provider,
    config=TraceConfig(hide_inputs=True),  # optional
)
```

## `openinference.instrumentation.litellm`

### `is_iterable_of`

_function_ · [Source](https://github.com/Arize-ai/openinference/blob/main/python/instrumentation/openinference-instrumentation-litellm/src/openinference/instrumentation/litellm/__init__.py#L126-L127)

```python
def is_iterable_of(lst: Iterable[object], tp: T) -> bool
```

### `LiteLLMInstrumentor`

_class_ · [Source](https://github.com/Arize-ai/openinference/blob/main/python/instrumentation/openinference-instrumentation-litellm/src/openinference/instrumentation/litellm/__init__.py#L1353-L1722)

```python
class LiteLLMInstrumentor(BaseInstrumentor)
```

**Attributes**

| Name | Type and value |
| - | - |
| [`original_litellm_funcs`](https://openinf.dev/python/openinference-instrumentation-litellm.html.md#openinference.instrumentation.litellm.LiteLLMInstrumentor.original_litellm_funcs) | `Dict[str, Callable[..., Any]] = {}` |
| [`original_anthropic_funcs`](https://openinf.dev/python/openinference-instrumentation-litellm.html.md#openinference.instrumentation.litellm.LiteLLMInstrumentor.original_anthropic_funcs) | `Dict[str, Callable[..., Any]] = {}` |
| [`original_anthropic_signatures`](https://openinf.dev/python/openinference-instrumentation-litellm.html.md#openinference.instrumentation.litellm.LiteLLMInstrumentor.original_anthropic_signatures) | `Dict[str, inspect.Signature] = {}` |

#### `instrument`

_method_

```python
def instrument(
    *,
    tracer_provider: Optional[TracerProvider] = None,
    config: Optional[TraceConfig] = None,
    skip_dep_check: bool = False,
) -> None
```

Start tracing the library: patch it so its calls make OpenInference spans. Calling it again does nothing. Inherited from OpenTelemetry’s [`BaseInstrumentor`](https://opentelemetry-python-contrib.readthedocs.io/en/latest/instrumentation/base/instrumentor.html).

**Parameters**

| Name | Description |
| - | - |
| `tracer_provider` | The tracer provider the spans are made with. Defaults to the global one, `opentelemetry.trace.get_tracer_provider()`. |
| `config` | What the spans record: hide inputs, outputs or messages, or limit image sizes. Defaults to `TraceConfig()`, which reads the `OPENINFERENCE_*` environment variables. See [`TraceConfig`](https://openinf.dev/python/openinference-instrumentation.html.md#openinference.instrumentation.TraceConfig). |
| `skip_dep_check` | Instrument even if the installed version of the library is outside the supported range. |

#### `uninstrument`

_method_

```python
def uninstrument() -> None
```

Stop tracing: undo the patches `instrument()` made. Inherited from OpenTelemetry’s [`BaseInstrumentor`](https://opentelemetry-python-contrib.readthedocs.io/en/latest/instrumentation/base/instrumentor.html).

#### `instrumentation_dependencies`

_method_ · [Source](https://github.com/Arize-ai/openinference/blob/main/python/instrumentation/openinference-instrumentation-litellm/src/openinference/instrumentation/litellm/__init__.py#L1362-L1363)

```python
def instrumentation_dependencies() -> Collection[str]
```
