One of the challenges of working with annotations at scale is training and evaluating human annotators. Here we…