Braintrust for AI agents
Agents read Braintrust at once. Changes and sends are held for a person's approval by default.
About Braintrust
Braintrust is an AI engineering platform for managing prompts, datasets, experiments, evaluations, observability, and production AI applications.
What an agent can do in Braintrust
Every Braintrust action is classed by the platform as a read, a change or a send. Reads run at once. Changes and sends are held for a person by default.
Runs at once (reads)
Looks things up in Braintrust without asking first. 5 actions.
- Fetch EventsFetch one newest-to-oldest page of project log, experiment, or dataset events.
- Get Braintrust ResourceGet one project, experiment, dataset, prompt, or function by UUID.
- List Braintrust ResourcesList and filter one page of projects, experiments, datasets, prompts, or functions visible to the connected Braintrust API key.
- Query Braintrust DataRun one bounded synchronous read-only BTQL query over Braintrust project logs, an experiment, or a dataset. The first-page query must end with a positive LIMIT; continue later pages by passing the ret
- Summarize Experiment or DatasetReturn metadata and optional aggregate summaries for one Braintrust experiment or dataset.
Held for approval by default (changes and sends)
Held for a person's approval by default. The approval is recorded and the action is sent once, never twice, with 10 seconds to undo. 12 actions.
- Create DatasetCreate a named dataset under a Braintrust project, or return the existing dataset unchanged when its name already exists in that project.
- Create ExperimentCreate an experiment under a Braintrust project. When its name already exists, Braintrust returns the existing experiment unchanged unless ensure_new is true, which creates an experiment with a unique
- Create ProjectCreate a Braintrust project, or return the existing project unchanged when its name already exists.
- Create PromptUpsert a versioned prompt configuration under a Braintrust project without invoking it. The same project and slug reuse the prompt ID but create a new version that replaces the stored prompt configura
- Delete ProjectSoft-delete a Braintrust project and return its deletion state.
- Delete Experiment, Dataset, or PromptDelete one Braintrust experiment, dataset, or prompt by UUID for explicit lifecycle cleanup.
- Insert Dataset EventsUpsert a batch of examples into an existing Braintrust dataset. New or omitted IDs insert events; an existing supplied ID replaces that event's current values.
- Insert Experiment EventsUpsert a batch of result events into an existing Braintrust experiment. New or omitted IDs insert events; an existing supplied ID replaces that event's current values.
- Update DatasetUpdate the name, description, tags, or metadata of a Braintrust dataset. At least one non-null mutable field is required.
- Update ExperimentUpdate selected metadata and linkage fields on a Braintrust experiment. At least one non-null mutable field is required.
- Update ProjectUpdate selected fields of a Braintrust project. At least one non-null mutable field is required: name, description, or settings.
- Update PromptUpdate a Braintrust prompt's metadata or configuration without invoking it. At least one non-null mutable field is required.
Changes wait in Needs you
Changes and sends in Braintrust are held for a person's approval by default. The approval is recorded, and the action is sent once, never twice, with 10 seconds to undo.
Related connectors
Braintrust questions
Can an agent change data in Braintrust on its own?
Not by default. Changes and sends in Braintrust are held for a person's approval. The approval is recorded, and the action is sent once, never twice, with 10 seconds to undo.
What can an agent read in Braintrust?
This connector lists 5 read actions. Reads run at once, without waiting for approval.
How does Braintrust connect?
It connects with API key. Connectors are built and maintained by third-party developers; availability is confirmed during scoping.