Results 31 to 40 of about 3,180 (309)
An Enhanced Semantic Focused Web Crawler Based on Hybrid String Matching Algorithm
Cybernetics and Information Technologies, 2021 Topic precise crawler is a special purpose web crawler, which downloads appropriate web pages analogous to a particular topic by measuring cosine similarity or semantic similarity score.
Sakunthala Prabha K. S. +2 more
doaj +1 more source
Research on bearing capacity of cross-type truss boom with variable cross-section of Crawler cranes
Mechanics & Industry, 2023 The web crossed truss boom is one of the commonly used truss boom structures of crawler cranes. However, the existing calculations fail to consider the limiting effect of the web members' bending resistance on the chord members, and cannot give full play
Fenglin Yao +6 more
doaj +1 more source
Optimization of Distributed Crawler under Hadoop
MATEC Web of Conferences, 2015 Web crawler is an important link in the data acquisition of the World Wide Web. It is necessary to optimize traditional methods so as to meet the current needs in the face of the explosive growth of data.
Zhang Xiaochen, Xian Ming
doaj +1 more source
Hybrid focused crawling on the Surface and the Dark Web
EURASIP Journal on Information Security, 2017 Focused crawlers enable the automatic discovery of Web resources about a given topic by automatically navigating through the Web link structure and selecting the hyperlinks to follow by estimating their relevance to the topic of interest.
Christos Iliou +4 more
doaj +1 more source
Application of ARIMA(1,1,0) Model for Predicting Time Delay of Search Engine Crawlers [PDF]
Informatică economică, 2013 World Wide Web is growing at a tremendous rate in terms of the number of visitors and number of web pages. Search engine crawlers are highly automated programs that periodically visit the web and index web pages.
Jeeva JOSE, P. Sojan LAL
doaj +1 more source
The Data Extraction Using Distributed Crawler Inside Multi-Agent System
Advances in Electrical and Electronic Engineering, 2013 The paper discusses the use of web crawler technology. We created an application based on standard web crawler. Our application is determined for data extraction.
Karel Tomala +4 more
doaj +1 more source
KOMPRESI MULTILEVEL PADA METAHEURISTIC FOCUSED WEB CRAWLER
JUTI: Jurnal Ilmiah Teknologi Informasi, 2019 Focused Web Crawler merupakan metode pencarian website yang sesuai dengan pencarian yang diinginkan oleh user. Untuk mendapatkan kecocokan yang baik, waktu yang dibutuhkan metode Focused Web Crawler lebih lama dibandingkan dengan metode pencarian web ...
Dian Septiani Santoso, R.V. Hari Ginardi
doaj +1 more source
Study and optimization on system architectures of Larbin
网络与信息安全学报, 2016 Web crawler is an important part of the search engine,its performance will directly affect the accuracy and timeliness of the search engine.Larbin is an efficient and simple open source crawler with relatively perfect in functions.Several typical open ...
Xuan WANG +4 more
doaj +3 more sources
DEVELOPMENT OF A PROGRAM FOR COLLECTION OF WEBSITE STRUCTURE DATA
Transactions of the Karelian Research Centre of the Russian Academy of Sciences, 2016 The web graph is the most common mathematical model of a website. Constructing a web graph of a real site requires data about the structure of that site: html-pages and/or documents in the site (in particular, data about URLs of web resources) and ...
Andrey Pechnikov, Alexandr Lankin
doaj +1 more source
Crawling the German Health Web: Exploratory Study and Graph Analysis
Journal of Medical Internet Research, 2020 BackgroundThe internet has become an increasingly important resource for health information. However, with a growing amount of web pages, it is nearly impossible for humans to manually keep track of evolving and continuously changing content in the ...
Zowalla, Richard +2 more
doaj +1 more source