Langfuse for AI agents
Agents read Langfuse at once. Changes and sends are held for a person's approval by default.
About Langfuse
Open source LLM engineering platform. Traces, evals, prompt management and metrics to debug and improve your LLM application.
What an agent can do in Langfuse
Every Langfuse action is classed by the platform as a read, a change or a send. Reads run at once. Changes and sends are held for a person by default.
Runs at once (reads)
Looks things up in Langfuse without asking first. 9 actions.
- Get PromptRetrieve a Langfuse text or chat prompt by name, deployment label, or exact version, with optional dependency resolution.
- List Annotation QueuesList annotation queues configured for human evaluation in the connected Langfuse project.
- List Dataset ItemsList dataset items, optionally scoped to a dataset, source trace or observation, or historical dataset version.
- List DatasetsList datasets available to the connected Langfuse project.
- List ExperimentsList Langfuse experiments active in a required time range, optionally including metadata and directly attached scores.
- List ModelsList Langfuse-managed and project-custom model pricing definitions used for usage and cost calculation.
- List ObservationsSearch Langfuse observations such as generations, spans, events, agents, and tool calls, selecting only the field groups needed.
- List ScoresSearch numeric, boolean, categorical, text, and correction scores with subject and annotation context.
- Query MetricsRun an aggregate Langfuse metrics query over observations or numeric, boolean, or categorical scores.
Held for approval by default (changes and sends)
Held for a person's approval by default. The approval is recorded and the action is sent once, never twice, with 10 seconds to undo. 1 action.
- Create ScoreAttach an evaluation score to exactly one Langfuse trace, session, or dataset run, optionally narrowing a trace score to an observation.
Changes wait in Needs you
Changes and sends in Langfuse are held for a person's approval by default. The approval is recorded, and the action is sent once, never twice, with 10 seconds to undo.
Related connectors
Langfuse questions
Can an agent change data in Langfuse on its own?
Not by default. Changes and sends in Langfuse are held for a person's approval. The approval is recorded, and the action is sent once, never twice, with 10 seconds to undo.
What can an agent read in Langfuse?
This connector lists 9 read actions. Reads run at once, without waiting for approval.
How does Langfuse connect?
It connects with API key. Connectors are built and maintained by third-party developers; availability is confirmed during scoping.