> ## Documentation Index
> Fetch the complete documentation index at: https://developer.watson-orchestrate.ibm.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Monitoring your LLMs with Langfuse

Observability refers to the ability to monitor and understand the internal state of an LLM application, including its inputs and outputs.

watsonx Orchestrate provides observability through a native integration with an open-source project known as [Langfuse](https://langfuse.com/).

To enable IBM's native observability framework, start the Orchestrate server with the `--with-ibm-telemetry` or `-i` flag, then go to [https://localhost:8765](https://localhost:8765) in your browser.

## Enabling Langfuse on SaaS

You can configure your own hosted Langfuse instance for observability.

You can configure it directly in the CLI:

**Flags:**

| Flag                  | Description                                                                                               |
| --------------------- | --------------------------------------------------------------------------------------------------------- |
| `--url` / `-u`        | The URL of the Langfuse instance (required if not specified in `--config-file`).                          |
| `--health-uri`        | The Health URI of the Langfuse instance (required if not specified in `--config-file`).                   |
| `--project-id` / `-p` | The Langfuse project ID (required if not specified in `--config-file`).                                   |
| `--api-key`           | The Langfuse API key (required if not specified in `--config-file`).                                      |
| `--config-file`       | A config file for the Langfuse integration (can be fetched using orchestrate settings).                   |
| `--config-json`       | A config JSON object for the Langfuse integration, this object should contain your Langfuse `public_key`. |

```bash BASH [expandable] theme={null}
orchestrate settings observability langfuse configure \
--url "https://cloud.langfuse.com/api/public/otel" \
--api-key "sk-lf-0000-0000-0000-0000-0000" \
--health-uri "https://cloud.langfuse.com" \
--config-json '{"public_key": "pk-lf-0000-0000-0000-0000-0000"}'
```

Or using an external file in YAML format:

```yaml YAML [expandable] theme={null}
spec_version: v1
kind: langfuse
project_id: default
api_key: sk-lf-00000-00000-00000-00000-00000
url: https://cloud.langfuse.com/api/public/otel
host_health_uri: https://cloud.langfuse.com
config_json: 
   public_key: pk-lf-00000-00000-00000-00000-00000
mask_pii: true
```

```bash BASH theme={null}
orchestrate settings observability langfuse configure --config-file=path_to_file.yml
```