Application Managers

Overview

When a user creates a new application, the assumption is that they are the subject matter experts for the application type and data being set up. Cogniac defines this person as the Application Manager, and with that comes some privileges. The Application Manager will be responsible for the application configuration, including all settings and feedback consensus. Other users within the tenant can see the application and provide feedback. Still, the Application Manager (until others are designated Application Managers) owns the feedback confirmation and settings.

Users in the tenant will provide feedback on images to help with data labeling but cannot initially drive images to consensus. Because consensus is necessary to teach the model the ground truth, until a user has demonstrated sufficient accuracy, the Application Manager will be the ultimate user to label items as consensus.

Other feedback users also cannot drive images to consensus. Instead, items will be forwarded to the Application Manager's feedback queue. Initially, when new users are added, the feedback responsibility (confirmation) on the Application Manager will increase, but once the user has some history, this will taper off. Labeling images is critical to the system's accuracy, so reliance on verification from a trusted source is necessary.

Application Manager Setup

When a new application is created, the user who created the application is the default Application Manager.

To add additional users to the Application Managers list, go to the Application Settings and scroll to the bottom.

Select which users you want to be designated as Application Manager.

Future

The goal will be to maintain accuracy around the labeling process and establish an ongoing assessment of user feedback to prevent redundant feedback. Scoring the feedback will help identify labeling errors and help correct those from a hierarchical view.