Results 1 to 10 of about 1,941,493 (290)

Web scraping for research: Legal, ethical, institutional, and scientific considerations [PDF]

Big Data & Society
Scientists across disciplines often use data from the internet to conduct research, generating valuable insights about human behavior. However, as generative artificial intelligence relying on massive text corpora becomes increasingly valuable, platforms
Megan A Brown, Andrew Gruen, Gabe Maldoff, Solomon Messing, Zeve Sanderson, Michael Zimmer   +5 more
doaj   +3 more sources

Identifying kidney trade networks using web scraping data [PDF]

BMJ Global Health, 2022
Kidney trade has been on the rise despite the domestic and international law enforcement aiming to protect the vulnerable population from potential exploitation.
Amit Patel, Abu Bakkar Siddique, Naoru Koizumi, Meng-Hao Li, Brian Wilson, Hadi El-Amine   +5 more
doaj   +2 more sources

Utilizing Web Scraping Technology to Monitor Public Opinion on Environmental Policies [PDF]

ITM Web of Conferences
Web scraping, an automated tool for extracting and analyzing large amounts of data from websites and social media platforms, has become an essential practice for researchers and policymakers. This paper examines the application of web scraping technology
Cui Yue
doaj   +2 more sources

NLP-enhanced inflation measurement using BERT and web scraping [PDF]

Frontiers in Artificial Intelligence
In this research note, we explore the integration of natural language processing (NLP) and web scraping techniques to develop a custom price index for measuring inflation.
Martin Berki, Vanesa Andicsova, Milos Oravec   +2 more
doaj   +2 more sources

Web Scraping Using R [PDF]

Advances in Methods and Practices in Psychological Science, 2019
The ubiquitous use of the Internet in daily life means that there are now large reservoirs of data that can provide fresh insights into human behavior. One of the key barriers preventing more researchers from utilizing online data is that they do not have the skills to access the data.
Richard James, Alexander Bradley
exaly   +3 more sources

Taiwan Stock Tape Reading Periodically Using Web Scraping Technology with GUI

Applied System Innovation, 2022
Stock tape reading involves surveilling stock prices once in a while and recording stock prices. The method of observing stock prices may be television or stock exchange.
Chun-Feng Lin, Sheng-Chih Yang
doaj   +3 more sources

Web Scraping in the Statistics and Data Science Curriculum: Challenges and Opportunities

Journal of Statistics and Data Science Education, 2021
Best practices in statistics and data science courses include the use of real and relevant data as well as teaching the entire data science cycle starting with importing data.
Mine Dogucu, Mine Çetinkaya-Rundel
doaj   +2 more sources

Recovery resources for college students: Leveraging web scraping to unveil current estimates. [PDF]

Psychol Addict Behav
Objective: Growing recognition of the importance of addressing substance use among emerging adults has led to a rapid expansion of recovery services on college campuses. However, existing estimates on collegiate recovery programs or communities (CRPs/Cs)
Bell JS, Nieder A, Shore C, Blankenship A, Dolgoff E, Gipson M, Alnashri Y, Markham B, Murphy D, Singer A, Vest N.   +10 more
europepmc   +2 more sources

Web Scraping by End Users

IEEE Access
Scraping is a topic studied from various perspectives, encompassing automatic and AI-based approaches, and a wide range of programming libraries that expedite development.
Alex Tacuri, Sergio Firmenich, Alejandro Fernandez, Florencia Riva, Matias Urbieta, Gustavo Rossi   +5 more
doaj   +2 more sources

Prompt engineering for bibliographic web-scraping [PDF]

Scientometrics
Bibliographic catalogues store millions of data. The use of computer techniques such as web-scraping allows the extraction of data in an efficient and accurate manner.
Manuel Blázquez-Ochando, J. Prieto-Gutiérrez, M. Ovalle-Perandones   +2 more
semanticscholar   +4 more sources