Get Started with a Project

Please see the following micro-tutorial for a visual walkthrough of how to create a Project in RedBrick AI.

Creating a Project: Step by Step

To create a new Project, press the Create Project button on the Projects page;

Step 1: Specify a Unique Project Name

Each Project has a unique name that can be changed at any time within Project Settings;

Step 2: Select the Taxonomy for your Project

Taxonomies are stored at the Organization level, which allows you to reuse a single labeling Taxonomy across Projects.

Selecting a Taxonomy for a Project is a permanent choice that cannot be undone. However, you can edit your Taxonomy after using it in a Project.

Step 3: Define your Project Workflow

Project workflows allow you to explicitly define a series of annotation and review stages in your project.

You can also configure the number of review stages and the review percentage (i.e. randomly select a subset of data for pseudo-random review) in your workflow.

Once your data has successfully passed through all stages of your workflow, it will reach the Ground Truth Stage.

A common workflow included a single Label Stage followed by two Review Stages where different sets of reviewers validate the annotations performed.

When a reviewer rejects a Task in a Review Stage, it is sent back to the Label Stage and automatically assigned to the same Labeler who annotated it the first time.

The number of Review Stages cannot be modified after a workflow has been created. You can, however, disable a Review Stage by setting its Review Percentage to 0% in your Project Settings.

Additional Project Setup

Once you have successfully created a Project, you will most likely want to perform the following actions to add collaborators and data and modify Project settings.

Adding Labelers to your Project

By default, all Org Admins have comprehensive access to all Projects. As with any elevated role, we recommend taking care when designating fellow team members as Org Admins.

Generally speaking, it's advisable to add Labelers and Reviewers to your Organization as Org Members. This grants them access to your Organization on the RedBrick AI Web Application, but limits their access and permissions.

Org Admins have granular control over the Project-level access of all Org Members.

In order to add Labelers or Reviews to individual Projects, we recommend the following:

  1. On the Team Page, invite the Labeler/Reviewer as an Org Member (MEMBER).

  2. After the Labeler/Reviewer accepts their invitation and creates an account, navigate to the Project you'd like to add them to and open the Workforce Tab. From there, you can invite the Labeler/Reviewer to the Project as either a Project Admin or Project Member. Please note that if your Labeler/Reviewer is a Project Admin, they will have access to all Stages of a Project, as well as the Project Settings.

  3. If your Labeler/Reviewer is a Project Member, you can regulate their access to various Stages limited based on your workflow's needs or regulatory requirements.

For a more in-depth breakdown of the permissions and access privileges associated with each role, please consult the documentation below.

pageOrganization and Project Roles

Uploading Data

You can upload data to a Project either through the UI or CLI/SDK. Most teams tend to integrate external storage and host their own data, however, you can also directly upload data to RedBrick AI servers.

If you'd like to upload annotation files alongside your images and/or volumes, you must use our CLI/SDK.

pageImporting Data & Annotations

Assigning Tasks

Once you have uploaded data to your Project, RedBrick AI will begin automatically assigning Tasks to the users in your Project. You can learn more about the specifics of task assignment by referencing the documentation below.

pageTask Assignment

Last updated

Logo

Designed and built for radiology AI