Results 11 to 20 of about 28,826 (240)
Journal of Global Business Insights, 2021 Introduction Researchers around the globe are utilizing crowdsourcing tools to reach respondents for quantitative and qualitative research (Chambers & Nimon, 2019).
Cihan Cobanoglu +2 more
doaj +2 more sources
PLoS ONE, 2023 With the proliferation of online data collection in human-subjects research, concerns have been raised over the presence of inattentive survey participants and non-human respondents (bots).
Benjamin D Douglas +2 more
doaj +2 more sources
Incorporating Worker Perspectives into MTurk Annotation Practices for NLP
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023 Current practices regarding data collection for natural language processing on Amazon Mechanical Turk (MTurk) often rely on a combination of studies on data quality and heuristics shared among NLP researchers. However, without considering the perspectives of MTurk workers, these approaches are susceptible to issues regarding workers' rights and poor ...
Huang, Olivia, Fleisig, Eve, Klein, Dan
openaire +3 more sources
Research & Politics, 2015 As Amazon’s Mechanical Turk (MTurk) has surged in popularity throughout political science, scholars have increasingly challenged the external validity of inferences made drawing upon MTurk samples.
Connor Huff, Dustin Tingley
doaj +2 more sources
Common Concerns with MTurk as a Participant Pool: Evidence and Solutions
, 2018 In this chapter, we outline the common concerns with MTurk as a participant pool, review the evidence for those concerns, and discuss solutions.
David Hauser +2 more
openaire +4 more sources
Why you shouldn’t trust data collected on MTurk
Behavior Research MethodsSeveral prior studies have used advanced methodological techniques to demonstrate that there isan issue with the quality of data on Amazon’s Mechanical Turk (MTurk). The goal of the presentpreregistered project was to provide an accessible demonstration of this issue by showing thatpairs of items assessing clearly contradictory content (e.g., “I talk a
Cameron S Kay
openaire +2 more sources
Crowdsourcing in Computing Education Research: Case Amazon MTurk [PDF]
Koli Calling '20: Proceedings of the 20th Koli Calling International Conference on Computing Education Research, 2020 Crowdsourcing platforms such as Amazon MTurk provide access to a human workforce that can be given tasks to complete online for a fee. In this article, we review studies in computing education research (CER) that rely on crowdsourcing; we also describe our own experiences of using Amazon MTurk for a CER study.
Zavgorodniaia, Albina +3 more
openaire +2 more sources
Evaluating CloudResearch’s Approved Group as a solution for problematic data quality on MTurk
Behavior Research Methods, 2021 Maintaining data quality on Amazon Mechanical Turk (MTurk) has always been a concern for researchers. These concerns have grown recently due to the bot crisis of 2018 and observations that past safeguards of data quality (e.g., approval ratings of 95 ...
David N. Hauser +5 more
semanticscholar +1 more source
The Daily Lives of Crowdsourced U.S. Respondents: A Time Use Comparison of MTurk, Prolific, and ATUS. [PDF]
Sociol MethodolAmazon’s Mechanical Turk (MTurk) and Prolific are popular online platforms for connecting academic researchers with respondents. A broad literature has sought to assess the extent to which these respondents are representative of the U.S.
Rinderknecht RG, Doan L, Sayer LC.
europepmc +2 more sources
Comparing Online Surveys for Cybersecurity: SONA and MTurk [PDF]
ICST Transactions on Security and Safety, 2022 People have many accounts and usually need to create a password for each. They tend to create insecure passwords and re-use passwords, which can lead to compromised data. This research examines if there is a link between personality type and password security among a variety of participants in two groups of participants: SONA and MTurk.
Wagner, Anne +3 more
openaire +3 more sources