You can review assets in two ways:
- You manually select the annotated assets.
- Assets are randomly selected for review from the review queue.
In both cases, the review interface is similar to the labeling interface and allows you to review labeled assets and then:
- Make corrections, if necessary
- Send assets back to the queue
To manually select labeled assets for review:
- From your project Queue page, run Filters to search for labeled assets
- From the Quick actions menu, select
Add to review
- From your project Queue page, or from the Explore view, run Filters to search for assets labeled
- Click to open a specific asset that you want to review.
- If the labels were added correctly, click Review.
Be careful when reviewing assets that are used as honeypot. Clicking the Review button changes the current honeypot setting for the asset.
- If the labels were added incorrectly, you can make corrections, if necessary or send assets back to labeling.
To send an asset back to the labeler:
- From your project Queue page, run Filters to search for specific assets
- Select assets
- From the Quick actions menu, click Send back to queue
Alternatively, you can use the issue button, accessible from the
- From your project Queue page, or from the Explore view run Filters to search for specific assets
- Open the asset
- Click the Issue button.
- Click Send back to queue.
Selected assets will return to the project Queue page with status "Ongoing".
- The asset returns to the queue of the same labeler who added the disputed label. Kili does not impose any specific timeframe for the labeler to update the label.
- If an asset is sent back to queue, it gets top labeling priority. This means that the labeler will see this asset as the first one to be labeled.
Updated 3 months ago