Skip to main content

Documentation Index

Fetch the complete documentation index at: https://developer.watson-orchestrate.ibm.com/llms.txt

Use this file to discover all available pages before exploring further.

Observability refers to the ability to monitor and understand the internal state of an LLM application, including its inputs and outputs. watsonx Orchestrate provides observability through a native integration with an open-source project known as Langfuse. To enable IBM’s native observability framework, start watsonx Orchestrate Developer Edition server with the --with-ibm-telemetry or -i flag, then go to https://localhost:8765 in your browser.

​
Enabling Langfuse on SaaS

You can configure your own hosted Langfuse instance for observability. You can configure it directly in the CLI:
BASH
orchestrate settings observability langfuse configure \
--url "https://cloud.langfuse.com/api/public/otel" \
--api-key "sk-lf-0000-0000-0000-0000-0000" \
--health-uri "https://cloud.langfuse.com" \
--config-json '{"public_key": "pk-lf-0000-0000-0000-0000-0000"}'
Or using an external file in YAML format:
YAML
spec_version: v1
kind: langfuse
project_id: default
api_key: sk-lf-00000-00000-00000-00000-00000
url: https://cloud.langfuse.com/api/public/otel
host_health_uri: https://cloud.langfuse.com
config_json: 
   public_key: pk-lf-00000-00000-00000-00000-00000
mask_pii: true
BASH
orchestrate settings observability langfuse configure --config-file=path_to_file.yml

​
Getting configuration settings

To retrieve details of your current Langfuse configuration, run the following command:
BASH
orchestrate settings observability langfuse get --output <output file path>

​
Removing configuration settings

To remove your current Langfuse configuration, run the following command:
BASH
orchestrate settings observability langfuse remove