Truth inference can help solve some difficult problems of data integration in crowdsourcing. Crowdsourced workers are not experts and their labeling ability varies greatly; therefore, in practical applications, it is difficult to determine whether the labels collected from a crowdsourcing platform are correct. This article proposes a novel algorithm called truth inference based on label confidence clustering (TILCC) to improve the quality of integrated labels for the single-choice classification problem in crowdsourcing labeling tasks. We obtain the label confidence via worker reliability, which is calculated from multiple noise labels using a truth discovery method, and then we generate the clustering features and use the K-means algorithm to cluster all the tasks into K different clusters. Each cluster corresponds to a specific class, and the tasks in the cluster are assigned a label. Compared with the performances of six state-of-the-art methods, MV, ZenCrowd, PM, CATD, GLAD, and GTIC, on 12 randomly selected real-world datasets, the performance of our algorithm showed many advantages: no need to set complex parameters, faster running speed, and significantly higher accuracy.

Crowdsourcing platforms collect massive dirty claims that are provided by sources for crowdsourced objects, which prompts truth inference to be proposed for crowdsourcing data denoising. Although current graph-based truth-inference methods achieve remarkable success by capturing complex crowdsourcing relationships, they typically suffer from two challenges: 1) They fail to obtain complete crowdsourcing relationships because of the structural limitations of crowdsourcing relationship graphs; 2) Their vector initialization methods for objects and sources are disturbed by claim noise, which limits them from obtaining correct object and source semantics. To cope with these challenges, we propose a novelTruth-Inference method viaReliabilityAggregation (TIRA) on an object-source graph. Specifically, we propose a hierarchical graph auto-encoder to adapt to a reasonable object-source graph, which enables TIRA to capture complete crowdsourcing relationships from multiple perspectives. To better guide TIRA, we design a vector initialization method based on source reliabilities to map the denoised claims to a representation space of objects and sources. Finally, TIRA aggregates the reliability information on an object-source graph to generate object embeddings for truth inference. We conducted extensive experiments on 12 real-world datasets. The experimental results demonstrate that our method significantly outperforms 12 state-of-the-art baselines in terms of the$accuracy$and$weighted\_{F}1$.