Results 231 to 240 of about 15,044 (285)

URL Rule Based Focused Crawler

2008 IEEE International Conference on e-Business Engineering, 2008
Vertical search engines use focused crawlers as their key component and develop some specific algorithms to select Web pages relevant to some pre-defined set of topics. Therefore, how to effectively build up a semantic pattern for specific topics is extremely important to such search engines.
Xiaolin Zheng, Tao Zhou, Zukun Yu, Deren Chen   +3 more
openaire   +1 more source

Freshness tuning in focused crawler

Proceedings of the International Conference & Workshop on Emerging Trends in Technology - ICWET '11, 2011
The dynamic web keeps on changing and unnoticing an important event makes the result incomplete. All of the web pages do not change. Even if some of them change, they do not do the same with same frequency. So, having the same revisit frequency for all earlier visited pages merely creates overheads and does not contribute positively to the result. Here'
S. Mali, S. Ninoriya, B. B. Meshram
openaire   +1 more source

Adaptive Focused Website Segment Crawler

2016 19th International Conference on Network-Based Information Systems (NBiS), 2016
Focused web crawler has become indispensable for vertical search engines that provide a search service for specialized datasets. These vertical search engines have to collect specific web pages in the web space, whereas search engines such as Google and Bing gather web pages from all over the world.
Tanaphol Suebchua, Arnon Rungsawang, Hayato Yamana   +2 more
openaire   +1 more source

An analyst-adaptive approach to focused crawlers

Proceedings of the 2013 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, 2013
The paper presents a general methodology to implement a flexible Focused Crawler for investigation purposes, monitoring, and Open Source Intelligence (OSINT). The resulting tool is specifically aimed to fit the operational requirements of law-enforcement agencies and intelligence analyst. The architecture of the semantic Focused Crawler features static
ZUNINO, RODOLFO, BISIO F, PERETTI C, SANGIACOMO F, SURLINELLI R, SCILLIA E, OTTAVIANO A.   +6 more
openaire   +1 more source

A focused crawler for Romanian words discovery

2014 RoEduNet Conference 13th Edition: Networking in Education and Research Joint Event RENAM 8th Conference, 2014
As all natural languages are subject to change over time and as the Web becomes more prevalent, it also constitutes a major source for identifying language evolution. Although these changes affect all linguistic branches ranging from phonetics, lexicon and grammar to semantics and pragmatics, we will focus only on discovering new potential words that ...
Ionut-Gabriel Radu, Rebedea, Traian
openaire   +1 more source

Support Vector Machine-Based Focused Crawler

2020
The Internet is an immense source of information. People use search engines to find desired web pages. All these web pages are gathered from the search engine by using web crawler. In traditional crawler, the information retrieval was based on the occurrence of keywords in a document due to which many irrelevant web pages were also retrieved.
Vanshita R. Baweja, Rajesh Bhatia, Manish Kumar   +2 more
openaire   +1 more source

Focused web crawlers and its approaches

2015 International Conference on Futuristic Trends on Computational Analysis and Knowledge Management (ABLAZE), 2015
Rapid growth of WWW poses unpredictable challenges for the crawlers and search engines. Focused Crawler main aim is to selectively seek out pages that are relevant to pre-define set of topic rather than to exploit all regions of web. In this paper a review of focused crawler approaches have been presented which is classify in to five categories ...
Anish Gupta, Priya Anand
openaire   +1 more source

A Multi-Threaded Semantic Focused Crawler

Journal of Computer Science and Technology, 2012
The Web comprises of voluminous rich learning content. The volume of ever growing learning resources however leads to the problem of information overload. A large number of irrelevant search results generated from search engines based on keyword matching techniques further augment the problem.
Punam Bedi, Anjali Thukral, Hema Banati, Abhishek Behl, Varun Mendiratta   +4 more
openaire   +1 more source

SAFSB: A self-adaptive focused crawler

2015 1st International Conference on Next Generation Computing Technologies (NGCT), 2015
There are about 3 billion indexed websites present in the WWW. Not all websites do not belong to a particular topic are indexed by a search engine say google.com, there are online platforms available where different users help the person asking for a (Universal Resource Locator) URL containing a topical information.
Dilip kumar Sharma, Mohd Aamir Khan
openaire   +1 more source

History-enhanced focused website segment crawler

2018 International Conference on Information Networking (ICOIN), 2018
The primary challenge in focused crawling research is how to efficiently utilize computing resources, e.g., bandwidth, disk space, and time, to find as many web pages related to a specific topic as possible. To meet this challenge, we previously introduced a machine-learning-based focused crawler that aims to crawl a group of relevant web pages located
Tanaphol Suebchua, Bundit Manaskasemsak, Arnon Rungsawang, Hayato Yamana   +3 more
openaire   +1 more source