Results 21 to 30 of about 13,834 (319)
Design and Implementation of A Focused Crawler—TargetCrawler [PDF]
International Journal of Grid and Distributed Computing, 2014 Adopting focused crawler to search web sites is the trend of next generation search engines. Design and implementation of a focused crawler - TargetCrawler is introduced in detail, including its overall architecture, main modules, working processes and two key algorithms, duplicate removing algorithm based on the Bloom filter and ranking algorithm ...
Feng Jian, Chen Jing-zhou, Cao Lei
openaire +1 more source
Energies, 2022 Bulk materials are necessary for hydropower construction. The bulk materials transportation (BMT) scheme is a guiding document for material supply, and its selection has a significant influence on hydropower construction.
Hao Wang +4 more
doaj +1 more source
Web Crawler for Indexing Video e-Learning Resources: A YouTube Case Study [PDF]
Informatică economică, 2019 The main objective of the current paper is to develop and validate an algorithm focused on au-tomatically indexing YouTube e-learning resources about a certain domain of interest.
Bogdan IANCU
doaj +1 more source
Complex & Intelligent Systems, 2023 Traditional semantic-based focused crawlers calculate the topical priority of hyperlink by linearly integrating topical similarity evaluation metrics and empirical weights.
Jingfa Liu +3 more
doaj +1 more source
Development and Evaluation of the Traction Characteristics of a Crawler EOD Robot
Applied Sciences, 2021 Today, terrestrial robots are used in a multitude of fields and for performing multiple missions. This paper introduces the novel development of a family of crawling terrestrial robots capable of changing very quickly depending on the missions they have ...
Lucian Ștefăniță Grigore +3 more
doaj +1 more source
State of the Art in Semantic Focused Crawlers [PDF]
, 2009 Nowadays, the research of focused crawler approaches the field of semantic web, along with the appearance of increasing semantic web documents and the rapid development of ontology mark-up languages. Semantic focused crawlers are a series of focused crawlers enhanced by various semantic web technologies. In this paper, we make a survey in this research
Dong, Hai +2 more
openaire +2 more sources
Discovering Land Cover Web Map Services from the Deep Web with JavaScript Invocation Rules
ISPRS International Journal of Geo-Information, 2016 Automatic discovery of isolated land cover web map services (LCWMSs) can potentially help in sharing land cover data. Currently, various search engine-based and crawler-based approaches have been developed for finding services dispersed throughout the ...
Dongyang Hou, Jun Chen, Hao Wu
doaj +1 more source
Hybrid focused crawling on the Surface and the Dark Web
EURASIP Journal on Information Security, 2017 Focused crawlers enable the automatic discovery of Web resources about a given topic by automatically navigating through the Web link structure and selecting the hyperlinks to follow by estimating their relevance to the topic of interest.
Christos Iliou +4 more
doaj +1 more source
Development of Focused Crawlers for Building Large Punjabi News Corpus
Journal of ICT Research and Applications, 2021 Web crawlers are as old as the Internet and are most commonly used by search engines to visit websites and index them into repositories. They are not limited to search engines but are also widely utilized to build corpora in different domains and ...
Gurjot Singh Mahi, Amandeep Verma
doaj +1 more source
An architecture for a focused trend parallel web crawler with the application of clickstream analysis [PDF]
, 2012 The tremendous growth of the Web poses many challenges for all-purpose single-process crawlers including the presence of some irrelevant answers among search results and the coverage and scaling issues regarding the enormous dimension of the World Wide ...
Ahmadi-Abkenari, Fatemeh, Selamat, Ali
core +1 more source