Last week, Twitter announced the launch of Clockwork Raven, an open source web application built on Mechanical Turk’s platform.
Originally, Twitter developed Clockwork Raven as an internal tool with the following goal in mind: optimize the speed and cost efficiency of collecting accurate human evaluations used in the development of new and existing products.
Twitter leverages Clockwork Raven in critical workflows requiring human intellect that cannot be automated. Examples include collecting thousands of subjective judgments from Workers (“How relevant is this Tweet to this user?”), conducting research (“Find 10 Twitter users that relate to this topic”) and evaluating the effectiveness of algorithms (“Does this topic match this Tweet?”).
Now, as an open source application, Clockwork Raven’s flexible interface can be customized and used by anyone to access Mechanical Turk’s scalable, on-demand workforce. The application’s features include a drag-and-drop HIT builder that enables you to design your own components, the ability to target and manage top-notch workers and integrated tools for analyzing results across multiple dimensions.
To learn more about how you or your company can use Clockwork Raven to leverage Mechanical Turk see the application on GitHub.
Read more about the launch on Twitter’s Engineering Blog.
Clockwork Raven was developed by Ben Weissman with the support of Edwin Chen and David Buchfuher.