Results 1 to 10 of about 23,388 (326)

APLIKASI WEB CRAWLER UNTUK WEB CONTENT PADA MOBILE PHONE [PDF]

open access: yesJUTI: Jurnal Ilmiah Teknologi Informasi, 2009
Crawling is the process behind a search engine, which served through the World Wide Web in a structured and with certain ethics. Applications that run the crawling process is called Web Crawler, also called web spider or web robot.
Sarwosri Sarwosri   +2 more
doaj   +5 more sources

An Enhanced Semantic Focused Web Crawler Based on Hybrid String Matching Algorithm [PDF]

open access: diamondCybernetics and Information Technologies, 2021
Topic precise crawler is a special purpose web crawler, which downloads appropriate web pages analogous to a particular topic by measuring cosine similarity or semantic similarity score.
Sakunthala Prabha K. S.   +2 more
doaj   +2 more sources

The Data Extraction Using Distributed Crawler Inside Multi-Agent System [PDF]

open access: yesAdvances in Electrical and Electronic Engineering, 2013
The paper discusses the use of web crawler technology. We created an application based on standard web crawler. Our application is determined for data extraction.
Karel Tomala   +4 more
doaj   +4 more sources

Myanmar Web Pages Crawler

open access: bronzeInternational Journal on Web Service Computing, 2015
Nowadays web pages are implemented in various kinds of languages on the Web and web crawlers are important for search engine. Language specific crawlers are crawlers that traverse and collect the relative web pages using the successive URls of web page. There are very few research areas in crawling for Myanmar Language web sites.
Su Mon Khine, Yadana Thein
openalex   +3 more sources

Nuevos retos de la tecnología web crawler para la recuperación de información

open access: diamondMétodos de Información, 2014
El web crawler constituye una parte importante de la cadena documental en la recuperación de información, dado que genera el corpus documental necesario sobre el que aplicar los distintos algoritmos de recuperación.
Blázquez Ochando, Manuel
doaj   +3 more sources

Effective Web Page Crawler [PDF]

open access: yesEngineering and Technology Journal, 2011
The World Wide Web (WWW) has grown from a few thousand pages in 1993 to more than eight billion pages at present. Due to this explosion in size, web search engines are becoming increasingly important as the primary means of locating relevant information.
Hilal Hadi Saleh, Israa Ali
doaj   +2 more sources

Design, implementation and experiment of a YeSQL Web Crawler [PDF]

open access: green, 2012
We describe a novel, "focusable", scalable, distributed web crawler based on GNU/Linux and PostgreSQL that we designed to be easily extendible and which we have released under a GNU public licence.
Deveaud, Romain   +4 more
core   +2 more sources

A Brief History of Web Crawlers [PDF]

open access: yes, 2014
Web crawlers visit internet applications, collect data, and learn about new web pages from visited pages. Web crawlers have a long and interesting history. Early web crawlers collected statistics about the web.
Bochmann, Gregor V.   +5 more
core   +3 more sources

An MLLM-Assisted Web Crawler Approach for Web Application Fuzzing

open access: goldApplied Sciences
Web application fuzzing faces significant challenges in achieving comprehensive test interface (attack surface) coverage, primarily due to the complexity of user interactions and dynamic website architectures.
Wantong Yang   +5 more
doaj   +2 more sources

Web crawler research methodology [PDF]

open access: yes, 2011
In economic and social sciences it is crucial to test theoretical models against reliable and big enough databases. The general research challenge is to build up a well-structured database that suits well to the given research question and that is cost ...
Nemeslaki, András   +1 more
core   +3 more sources

Home - About - Disclaimer - Privacy