Managing Projects

Projects are workspaces within an organization for agent testing. Each project groups the agent runs you evaluate, the human evaluations layered on top of them, and the team members who carry that work out.

Creating a project

Navigate to Projects from the admin sidebar.
Click Create Project.
Enter a Project Name (required).
Click Create Project.

You are redirected to the new project's dashboard.

When a project is created, two default contributor types are automatically set up: Expert (marked as the default) and Reviewer. You can rename, add, or remove contributor types from the project's Team page. See Contributor types.

Project dashboard

Each project has a dashboard accessible from the project sidebar. The dashboard includes timeframe and pipeline selectors at the top, and shows the following widgets:

Widget	What it shows
Run Completion	Percentage of agent runs that have reached a final outcome, shown as a progress ring.
Runs	A composite view of created runs, completed runs, and human evaluations, with trend data and a timeseries chart.
First Review Pass Rate	How often human evaluations pass review on the first attempt.
Contributors	Total contributors, active in the selected period, and active today.
Avg Reviews per Review Node	Average number of review rounds per run.
Submission Stats	Average evaluations per active contributor and the maximum by a single contributor, with a chart.

What Project Admins can do

Project Admin Owners have full control over the project:

Configure agents — set up the agents under test within the project. See Agents.
Manage runs and evaluations — organize agent runs and the human-eval tasks layered on them. See Tasks.
Team — add or remove team members and assign roles. See Team Management.

Project Admin Viewers have read-only access — they can view dashboards and run data but cannot modify agents, runs, or team configuration.

Active and archived projects

Projects can be in two states:

Active — the default state. Visible in the project list, sidebar, and accessible to all assigned team members.
Archived — hidden from the default project list and from contributors. All data is preserved. Archived projects can be restored.

Archiving a project

Only Org Admins and Project Admin Owners can archive a project.

Go to the Projects page.
Click the three-dot menu (⋮) on the project card.
Select Archive.
A confirmation dialog appears. If the project has active pipelines, the dialog will warn you (e.g., "This project has 3 active pipeline(s)").
Click Archive to confirm.

Archived projects are hidden from contributors. Contributors will no longer see the project in their sidebar or work queue. All data — including agent configurations, runs, and evaluations — is preserved.

Archiving does not change the status of pipelines within the project. Pipelines remain in their current state (Active, Paused, etc.) but are effectively inaccessible because the project is hidden from contributors. If you need to explicitly pause pipelines before archiving, do so from each pipeline's settings.

Viewing and restoring archived projects

On the Projects page, switch to the Archived tab.
Click the three-dot menu (⋮) on the archived project card.
Select Unarchive.
Confirm in the dialog.

The project becomes active and visible to team members again. Pipelines within the project retain whatever status they had before archiving — if they were Active, they will be Active again and contributors can resume their evaluation work.

Deleting a project

Only Org Admins and Project Admin Owners can delete a project.

Click the three-dot menu (⋮) on the project card.
Select Delete.
A confirmation dialog will ask you to confirm.

Deletion is permanent and cannot be undone. All agent configurations, runs, evaluations, and associated data within the project are removed.

Other project card actions

The three-dot menu on each project card also includes:

Add Admin — quickly assign a Project Admin to this project.
Edit Name — rename the project.

On this page