Results 21 to 30 of about 28,826 (240)

Quality control questions on Amazon’s Mechanical Turk (MTurk): A randomized trial of impact on the USAUDIT, PHQ-9, and GAD-7

open access: yesBehavior Research Methods, 2021
Crowdsourced psychological and other biobehavioral research using platforms like Amazon’s Mechanical Turk (MTurk) is increasingly common – but has proliferated more rapidly than studies to establish data quality best practices.
J. Agley   +3 more
semanticscholar   +1 more source

Participant Crosstalk: Issues When Using the Mechanical Turk [PDF]

open access: yesTutorials in Quantitative Methods for Psychology, 2017
Past participants often talk about studies to those who have not yet participated (a problem termed participant crosstalk). Despite research exploring this issue in traditional settings, no research has explored crosstalk that occurs in online forums (in
Edlund, John E.   +5 more
doaj   +1 more source

A Needle in a Haystack: An Analysis of High-Agreement Workers on MTurk for Summarization [PDF]

open access: yesAnnual Meeting of the Association for Computational Linguistics, 2022
To prevent the costly and inefficient use of resources on low-quality annotations, we want a method for creating a pool of dependable annotators who can effectively complete difficult tasks, such as evaluating automatic summarization.
Lining Zhang   +10 more
semanticscholar   +1 more source

Assessing the Efficacy of a Participant-Vetting Procedure to Improve Data-Quality on Amazon’s Mechanical Turk

open access: yesMethodology, 2022
In recent years, Amazon’s Mechanical Turk (MTurk) has become a pivotal source for participant recruitment in many social-science fields. In the last several years, however, concerns about data quality have arisen.
Emilio D. Rivera   +4 more
doaj   +1 more source

Rational Herding in Reward-Based Crowdfunding: An MTurk Experiment [PDF]

open access: yesSustainability, 2020
Crowdfunding is gaining popularity as a way of financing social sustainable initiatives. We performed a controlled economic experiment in MTurk by simulating a crowdfunding platform and developed a theoretical model that rationalizes herding behavior. The experiment was designed to test and quantify the causal effects of revealing specific information ...
Irene Comeig   +3 more
openaire   +2 more sources

Are Mechanical Turk worker samples representative of health status and health behaviors in the U.S.? [PDF]

open access: yesPLoS ONE, 2018
INTRODUCTION:Amazon's Mechanical Turk (MTurk) is frequently used to administer health-related surveys and experiments at a low cost, but little is known about its representativeness with regards to health status and behaviors.
Kelly Walters   +2 more
doaj   +1 more source

Comparison of data from six psychotherapy research measures obtained through MTurk versus traditional clinics

open access: yesCounselling and Psychotherapy Research, 2023
Although researchers have begun to use MTurk for psychotherapy‐related studies, little is known about the quality of psychotherapy research data that can be obtained through this platform.
Kelley A. Russell   +2 more
semanticscholar   +1 more source

Crowdsourcing image analysis for plant phenomics to generate ground truth data for machine learning. [PDF]

open access: yesPLoS Computational Biology, 2018
The accuracy of machine learning tasks critically depends on high quality ground truth data. Therefore, in many cases, producing good ground truth data typically involves trained professionals; however, this can be costly in time, effort, and money. Here
Naihui Zhou   +10 more
doaj   +1 more source

The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers [PDF]

open access: yesJudgment and Decision Making, 2015
Using capture-recapture analysis we estimate the effective size of the active Amazon Mechanical Turk (MTurk) population that a typical laboratory can access to be about 7,300 workers.
Neil Stewart   +6 more
doaj   +3 more sources

The Online Laboratory: Conducting Experiments in a Real Labor Market [PDF]

open access: yes, 2010
Online labor markets have great potential as platforms for conducting experiments, as they provide immediate access to a large and diverse subject pool and allow researchers to conduct randomized controlled trials. We argue that online experiments can be
Horton, John J.   +2 more
core   +2 more sources

Home - About - Disclaimer - Privacy