Settings and organization
Project settings
Rename a project, read its retention and content capture, set a default judge, and see what deleting a project removes.
Project settings has three tabs: General, Environments and Models. Open them from Settings in the sidebar footer, under This project.
General
Owners and Admins rename the project on General, up to 120 characters. URLs use ids, so a rename breaks no link and changes no Environment key.
The default judge Model can be set only through the API, by an Owner or Admin: PUT /projects/:projectId/settings with defaultJudgeModelId, a Model of this project. Only AI drafting of evaluator steps reads it; New run and Online rules do not preselect it.
Retention and content capture
Retention comes from the organization's plan (retentionDays): spans older than that are deleted. Each span gets its retention when it is ingested, so a plan change applies only to spans ingested after it. A platform admin can put a retention hold on an organization so its traces stop expiring. The Plan and retention panel on General shows the plan and the retention, but not the hold.
Whether prompts and completions are stored is the SDK's capture_content setting, not a project one. Traces show a redaction marker where content was not captured; see Configuration and privacy.
Delete a project
Owners and Admins delete a project with Delete project at the bottom of General. The confirm dialog counts what goes with it, and you type the name to confirm.
The project is deleted first, then its contents in the background, module by module: datasets, runs, Models, playground history, online rules, alerts and monitors, review queues, comments, prompts, agents and simulation runs, RL datasets and topics. Environments are deactivated, not deleted. Their stored traces are no longer listed and expire with retention.
Evaluators, collections and Providers are not touched. Export any dataset that holds golden data first. A step of the background delete that fails is logged, and the delete is not undone.
The other tabs are covered in Environments and keys and Models and providers. Score types for review are set in Annotate; see Score types and review queues.