Results 301 to 310 of about 75,725 (379)
Some of the next articles are maybe not open access.
A Survey of Modern Crawler Methods
CCEAI, 2022Web crawler is a kind of computer program to browse the World Wide Web (WWW) automatically and efficiently. In the information age, due to the explosive growth of Internet pages, it has become exceedingly difficult and time-consuming for people to search
Zixiang Chang
semanticscholar +1 more source
LEARNING-based Focused WEB Crawler
Journal of the Institution of Electronics and Telecommunication Engineers, 2021As the number of pages being published every day increases enormously, there is a consistent need to design an efficient crawler mechanism that can result in appropriate and efficient search results for the everyday query.
Naresh Kumar, Dhruv Aggarwal
semanticscholar +1 more source
Designing Web Crawler Based on Multi-threaded Approach For Authentication of Web Links on Internet
2022 6th International Conference on Electronics, Communication and Aerospace Technology, 2022In the generation with the growth of communication technology and improving social requirements, this web crawler has been used extensively in the majority of search engines and research fields. In single-threaded crawlers, concurrency cannot be achieved
Kuldeep Vayadande +5 more
semanticscholar +1 more source
International Journal of Web Information Systems, 2006
Tools for the assessment of the quality and reliability of Web applications are based on the possibility of downloading the target of the analysis. This is achieved through Web crawlers, which can automatically navigate within a Web site and perform proper actions (such as download) during the visit.
C. Girardi, RICCA, FILIPPO, P. Tonella
openaire +2 more sources
Tools for the assessment of the quality and reliability of Web applications are based on the possibility of downloading the target of the analysis. This is achieved through Web crawlers, which can automatically navigate within a Web site and perform proper actions (such as download) during the visit.
C. Girardi, RICCA, FILIPPO, P. Tonella
openaire +2 more sources
Reducing web crawler overhead using mobile crawler
2011 International Conference on Emerging Trends in Electrical and Computer Technology, 2011To search any information on the web users extensively use the search engines. As the growth of the World Wide Web exceeded all expectations, the search engines rely on web crawlers to maintain the index of billions of pages for efficient searching. The web crawlers have to interact with millions of hosts and retrieve the pages continuously to keep the
S Anbukodi, K Muthu Manickam
openaire +1 more source
Multi-body dynamics model of crawler wall-climbing robot
Proceedings of the Institution of Mechanical Engineers, Part K: Journal of Multi-body Dynamics, 2022In this paper, a crawler-type wall-climbing robot with negative pressure adsorption is designed. The dynamic model of the robot is established based on the method of discretizing the force load of the track shoe.
Yi Fang +4 more
semanticscholar +1 more source
Applied Sciences (Switzerland), 2020 The agriculture sector is currently facing the problems of aging and decreasing skilled labor, meaning that the future direction of agriculture will be a transition to automation and mechanization that can maximize efficiency and decrease costs. Moreover,
Joong-hee Han, Jay Hyoun Kwon
exaly +2 more sources
Proceedings of the 11th international conference on World Wide Web, 2002
In this paper we study how we can design an effective parallel crawler. As the size of the Web grows, it becomes imperative to parallelize a crawling process, in order to finish downloading pages in a reasonable amount of time. We first propose multiple architectures for a parallel crawler and identify fundamental issues related to parallel crawling ...
Junghoo Cho, Hector Garcia-Molina
openaire +1 more source
In this paper we study how we can design an effective parallel crawler. As the size of the Web grows, it becomes imperative to parallelize a crawling process, in order to finish downloading pages in a reasonable amount of time. We first propose multiple architectures for a parallel crawler and identify fundamental issues related to parallel crawling ...
Junghoo Cho, Hector Garcia-Molina
openaire +1 more source
Proceedings of the 21st Brazilian Symposium on Multimedia and the Web, 2015
The speed of information publishing in WWW is unprecedented. The individuals and organizations struggle to be up to date and find relevant knowledge from a tsunami of news, videos, posts, and comments. In the other hand, these contents (mostly bound to HTML pages) are unstructured and not explicitly classified.
Luiz Henrique Zambom Santana +2 more
openaire +1 more source
The speed of information publishing in WWW is unprecedented. The individuals and organizations struggle to be up to date and find relevant knowledge from a tsunami of news, videos, posts, and comments. In the other hand, these contents (mostly bound to HTML pages) are unstructured and not explicitly classified.
Luiz Henrique Zambom Santana +2 more
openaire +1 more source