NEW Real-World Data Collection and Expert Annotation Services by HumanSignal

Dashboards

Use project dashboards to monitor throughput, data quality, and member performance for a single project.

The project Dashboard tab gives managers, administrators, and owners a project-level view of how work is moving, where quality issues are appearing, and how members are performing.

Open a project and select Dashboard to access the project dashboards:

  • Throughput: Track velocity, remaining work, and time spent.
  • Data quality: Analyze agreement, dimension-level quality, and label confusion.
  • Members: Review annotator, reviewer, and model performance within the project.

Choose a project dashboard

Dashboard Use it to
Throughput Understand whether the project is moving at the expected pace, where work is blocked, and how annotation and review time are trending.
Data quality Investigate agreement, confusion between labels, quality by dimension, and the tasks behind quality issues.
Members Compare annotator, reviewer, and model performance, including agreement, review outcomes, time spent, and per-dimension performance.

Access by user role

Project dashboards are available to users who can manage or monitor the project, such as Owners, Administrators, and Managers.

Annotators and Reviewers generally do not use the project Dashboard tab. For individual work history across projects, see the Member Performance dashboard.

Filtering and drilldowns

Each project dashboard has filters that apply to the metrics on that page. Depending on the dashboard, you can filter by date range, task data, annotator, model, review outcome, ground truth status, labeling dimension, or label.

Many cards, charts, and tables link to the Data Manager with relevant filters applied. Use these drilldowns to move from a summary metric to the exact tasks, annotations, predictions, or labels behind it.

Analytics dashboards

Analytics dashboards are available from the main Analytics navigation and can include data across projects, workspaces, or individual members depending on your role.

Dashboard Description
Projects overview dashboard Monitor progress across multiple projects and workspaces.
Label Distribution dashboard Compare annotation and prediction value distributions for project dimensions.
Member Performance dashboard Review an individual member’s annotation and review activity across projects.