The challenge

Smart companies see the pile of unstructured text floating through the digital realm as a strategic goldmine, opening the door to sophisticated consumer insights in real time. However, quantifying something as subjective as sentiment is no easy task. One person’s “positive” doesn’t always match their neighbor’s, and even short phrases sometimes require interpretation (“I love this stupid little office,” for example).

That’s why when a Fortune 500 tech company came to DefinedCrowd seeking sentiment annotation data in Korean, they needed a data partner capable of both collecting and annotating 10,000 input phrases and accounting for the subjectivity inherent to sentiment judgments.