Results 271 to 280 of about 3,180 (309)

Smart Focused Web Crawler for Hidden Web

2018
Huge amount of useful data is buried under the layers of hidden web that is accessible when submit forms are filled by users. Web crawlers can access this data only by interacting with web-based search forms. Traditional search engines cannot efficiently search and index these deep or hidden web pages. Retrieving data with high accuracy and coverage in
Sawroop Kaur, G. Geetha
openaire   +1 more source

Agents, Crawlers, and Web Retrieval

2002
In this paper we survey crawlers, a specific type of agents used by search engines. We also explore the relation with generic agents and how agent technology or variants of it could help to develop search engines that are more effective, efficient, and scalable.
Ricardo Baeza-Yates, José Miguel Piquer
openaire   +1 more source

NoSQL Web Crawler Application

2018
Abstract With the advent of Web technology, the Web is full of unstructured data called Big Data. However, these data are not easy to collect, access, and process at large scale. Web Crawling is an optimization problem. Site-specific crawling of various social media platforms, e-Commerce websites, Blogs, News websites, and Forums is a requirement for
openaire   +1 more source

Effective web crawlers

Web crawlers are the component of a search engine that must traverse the Web, gathering documents in a local repository for indexing by a search engine so that they can be ranked by their relevance to user queries. Whenever data is replicated in an autonomously updated environment, there are issues with maintaining up-to-date copies of documents.When ...
openaire   +1 more source

Soft robotic origami crawler

Science Advances, 2022
Qiji Ze, Shuai Wu, Sophie Leanza
exaly  

A magnetic crawler wall-climbing robot with capacity of high payload on the convex surface

Robotics and Autonomous Systems, 2022
Tao yourui
exaly  

Novel method for industrial sewage outfall detection: Water pollution monitoring based on web crawler and remote sensing interpretation techniques

Journal of Cleaner Production, 2021
Jing Zhang
exaly  

MYANMAR WEB PAGES CRAWLER

Nowadays web pages are implemented in various kinds of languages on the Web and web crawlers are important for search engine. Language specific crawlers are crawlers that traverse and collect the relative web pages using the successive URls of web page. There are very few research areas in crawling for Myanmar Language web sites.
openaire   +1 more source

LEARNING-based Focused WEB Crawler

IETE Journal of Research, 2023
Naresh Kumar, Dhruv Aggarwal
exaly  

Tracing algorithm and control strategy for crawler rice combine harvester auxiliary navigation system

Biosystems Engineering, 2021
Zhuohuai Guan
exaly