Sign In

Communications of the ACM

ACM TechNews

Making Crowdsourcing More Reliable


Victor Naroditskiy

University of Southampton researcher Victor Naroditskiy

Credit: Victor Naroditskiy

One of the major obstacles in crowdsourcing information gathering is the reliability of collected reports, but researchers at the University of Southampton and the University of California, San Diego say they have developed methods for solving this problem. The researchers' methods involve crowdsourcing verification as well as information gathering.

"The success of an information-gathering task relies on the ability to identify trustworthy information reports, while false reports are bound to appear either due to honest mistakes or sabotage attempts," says Southampton researcher Victor Naroditskiy. "This information verification problem is a difficult task, which, just like the information-gathering task, requires the involvement of a large number of people."

The researchers have developed methods for combining incentives to recruit participants to verify information, according to Madsar Institute professor Iyad Rahwan. The methods involve compensations to the recruiter and to the reporting participant for submitting the correct report, as well as penalties for incorrect reports, which ensures the recruiter will perform verification.

From University of Southampton (United Kingdom)
View Full Article

Abstracts Copyright © 2012 Information Inc., Bethesda, Maryland, USA 


 

No entries found