Since we introduced the Categorization Application (App), Requesters have asked us to add support for more categories and multiple levels. We’re pleased to announce that the Categorization App now supports ten top level categories with ten subcategories each, for a total of one hundred categories.
The Categorization App incorporates the best practices and insights we’ve collected helping Requesters achieve success including everything you need to be immediately successful:
- predesigned HIT interfaces (no HTML required),
- the ability to customize your own categories,
- built-in tools that make it easy to review results, and
- Recommended pricing for categorization HITs.
To create HITs with two tiers of categories, the Categorization App guides you through four simple steps: creating the categories, uploading your data to be categorized, previewing your HIT and check out. First provide your top-level categories. Then, add a second level of categories by selecting “Create Subcategories” and entering the subcategories you wish to include under each top-level category. In the example below, if a Worker is categorizing a sleigh bed, you would expect a result of “Furniture” as the top level category and “Beds” as the subcategory.
Once you’ve provided the category names, you will be asked to provide instructions. It’s important to provide clear selection criteria for your categories to guide Workers and avoid confusion. We recommend providing Workers examples of items that should be included in or excluded from each category as additional guidance (see screenshot below).
At checkout, the Categorization App recommends a Worker reward based on the price of similar HITs in the Mechanical Turk marketplace enabling Requesters to adjust pricing if necessary.
To check out the new Categorization App features, select “Categorization” under the “Create” Tab from the Mechanical Turk Requester home page.