Results 251 to 260 of about 15,044 (285)

A Simple Focused Crawler

2003
A focused crawler may be described as a crawler which returns relevant web pages on a given topic in traversing the web. There are a number of issues related to existing focused crawlers, in particular the ability to ``tunnel'' through lowly ranked pages in the search path to highly ranked pages related to a topic which might re-occur further down the ...
A. C. TSOI, FROSALI, DANIELE, GORI, MARCO, M. HAGENBUCHNER, SCARSELLI, FRANCO   +4 more
openaire   +1 more source

A focused crawler for Dark Web forums

Journal of the American Society for Information Science and Technology, 2010
AbstractThe unprecedented growth of the Internet has given rise to the Dark Web, the problematic facet of the Web associated with cybercrime, hate, and extremism. Despite the need for tools to collect and analyze Dark Web forums, the covert nature of this part of the Internet makes traditional Web crawling techniques insufficient for capturing such ...
Tianjun Fu, Ahmed Abbasi, Hsinchun Chen
openaire   +1 more source

Where to Crawl Next for Focused Crawlers

2010
Since WWW provides a large amount of data, it is useful for innovative and creative activities of human beings to retrieve interesting and useful information effectively and efficiently from WWW. In this paper, we attempt to propose a focused crawler for individual activities.
Yuki Uemura, Tsuyoshi Itokawa, Teruaki Kitasuka, Masayoshi Aritsugi   +3 more
openaire   +1 more source

Improving Relevance Prediction for Focused Web Crawlers

2012 IEEE/ACIS 11th International Conference on Computer and Information Science, 2012
A key issue in designing a focused Web crawler is how to determine whether an unvisited URL is relevant to the search topic. Effective relevance prediction can help avoid downloading and visiting many irrelevant pages. In this paper, we propose a new learning-based approach to improve relevance prediction in focused Web crawlers.
M. S. Safran, A. Althagafi, null Dunren Che   +2 more
openaire   +1 more source

Comparing classification methods for link context based focused crawlers

2013 International Conference on Electronics, Computer and Computation (ICECCO), 2013
Focused crawlers aim to fetch pages only related to a specific subject area from millions of web pages on the Internet. The essential task in a focused crawler is to predict whether a page is related to the target subject area or not without actually fetching the page content itself.
Caliskan, Kamil, Ozcan, Rifat
openaire   +3 more sources

Smart Focused Web Crawler for Hidden Web

2018
Huge amount of useful data is buried under the layers of hidden web that is accessible when submit forms are filled by users. Web crawlers can access this data only by interacting with web-based search forms. Traditional search engines cannot efficiently search and index these deep or hidden web pages. Retrieving data with high accuracy and coverage in
Sawroop Kaur, G. Geetha
openaire   +1 more source

Optimization Techniques for Focused Web Crawlers

2023 3rd International Conference on Technological Advancements in Computational Sciences (ICTACS), 2023
Anish Gupta, Lalit Kumar Tyagi, Vibhash Singh Sisodia   +2 more
openaire   +1 more source

Implementation of Category-Wise Focused Web Crawler

2017
The size of the World Wide Web is increasing rapidly and has reached a point where it is difficult to handle and manage such amount of information. Search engines are used to gather, index and make available the information across the web for the users. A web crawler is an important part of search engine that finds all the information.
Jyoti Pruthi, null Monika
openaire   +1 more source

Empirical Study of POI-Oriented Focused Crawler

2013
Focused crawler is the core of the focused search engine, and the POI-oriented user need is a kind of new focused object which has not been well solved in previous studies. In this paper, we design and realize a POI-oriented focused crawler. The proposed focused crawler adopts classifiers to make relevant judgment and considers both current page’s ...
Xin Fan, Jun-sheng Zhou, Can-yu Cheng, Yi-chu Zhou, Di Yin   +4 more
openaire   +1 more source

A Novel Focused Crawler Based on Breadcrumb Navigation

2012
In this paper, a novel focused crawler based on Breadcrumb Navigation (BN) is proposed. It mainly leverages Breadcrumb Navigation in the webpages to reconstruct the website structures and resolve focused crawling problems. Different from some previous focused crawlers which use prediction models, the BN crawler firstly samples the web to construct the ...
Lizhi Ying, Xinhao Zhou, Jian Yuan, Yongfeng Huang   +3 more
openaire   +1 more source