Published on iDigBio (https://www.idigbio.org)

Home > Reaching Consensus in Crowdsourced Transcription of Biocollections Information

Reaching Consensus in Crowdsourced Transcription of Biocollections Information

Mon, 12/08/2014 - 10:36am -- ammatsun
TitleReaching Consensus in Crowdsourced Transcription of Biocollections Information
Publication TypeConference Paper
Year of Publication2014
AuthorsMatsunaga, Andréa [1], Mast Austin [2], and Fortes José A. B. [3]
Conference Name2014 IEEE 10th International Conference on e-Science
Date PublishedOct/2014
PublisherIEEE
Conference LocationGuarujá, Brazil
Other Numbers6972249
KeywordsAccuracy [4], Approximation algorithms [5], biocollections infrastructure [6], biodiversity [7], consensus algorithms [8], crowdsourcing [9], digitization [10], EF-1115210 [11], Heuristic algorithms [12], Materials [13], Optical character recognition software [14], Reliability [15]
AbstractCrowdsourcing can be a cost-effective method for tackling the problem of digitizing historical bio collections data, and a number of crowd sourcing platforms have been developed to facilitate interaction with the public and to design simple "Human Intelligence Tasks". However, the problem of reaching consensus on the response of the crowd is still challenging for tasks for which a simple majority vote is inadequate. This paper (a) describes the challenges faced when trying to reach consensus on data transcribed by different workers, (b) offers consensus algorithms for textual data and a consensus-based controller to assign a dynamic number of workers per task, and (c) proposes further enhancements of future crowd sourcing tasks in order to minimize the need for complex consensus algorithms. Experiments using the proposed algorithms show up to a 45-fold increase in ability to reach consensus when compared to majority voting using exact string matching. In addition, the controller is able to decrease the crowd sourcing cost by 55% when compared to a strategy that uses a fixed number of workers.
URLhttp://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6972249 [16]
DOI10.1109/eScience.2014.30 [17]
Source URL: https://www.idigbio.org/content/reaching-consensus-crowdsourced-transcription-biocollections-information-0

Links
[1] https://www.idigbio.org/biblio?f%5Bauthor%5D=643
[2] https://www.idigbio.org/biblio?f%5Bauthor%5D=798
[3] https://www.idigbio.org/biblio?f%5Bauthor%5D=653
[4] https://www.idigbio.org/biblio?f%5Bkeyword%5D=444
[5] https://www.idigbio.org/biblio?f%5Bkeyword%5D=445
[6] https://www.idigbio.org/biblio?f%5Bkeyword%5D=400
[7] https://www.idigbio.org/biblio?f%5Bkeyword%5D=404
[8] https://www.idigbio.org/biblio?f%5Bkeyword%5D=446
[9] https://www.idigbio.org/biblio?f%5Bkeyword%5D=217
[10] https://www.idigbio.org/biblio?f%5Bkeyword%5D=12
[11] https://www.idigbio.org/biblio?f%5Bkeyword%5D=424
[12] https://www.idigbio.org/biblio?f%5Bkeyword%5D=447
[13] https://www.idigbio.org/biblio?f%5Bkeyword%5D=448
[14] https://www.idigbio.org/biblio?f%5Bkeyword%5D=449
[15] https://www.idigbio.org/biblio?f%5Bkeyword%5D=450
[16] http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6972249
[17] http://dx.doi.org/10.1109/eScience.2014.30