Results 1 to 10 of about 20,452 (164)
Large-scale geocoding via iterative deduplication: Building a unified address database in Brazil with CIDACS-RL [PDF]
International Journal of Population Data ScienceThis work aims to construct a dataset of unique addresses from Brazilian administrative, socioeconomic, and health databases. We assess the potential of iterative deduplication to generate a parent-duplicate data structure that supports address ...
Robespierre Pita +9 more
doaj +2 more sources
Data Deduplication With Random Substitutions [PDF]
IEEE Transactions on Information Theory, 2020 Data deduplication saves storage space by identifying and removing repeats in the data stream. Compared with traditional compression methods, data deduplication schemes are more time efficient and are thus widely used in large scale storage systems.
Hao Lou, Farzad Farnoud
openaire +4 more sources
Measurement: Sensors, 2022 Data deduplication in a system perspective is termed to be a single or multiple copy of an original data which could increase the computational complexity while accessing such a data.
K. Pragash, J. Jayabharathy
doaj +1 more source
DOMe: A deduplication optimization method for the NewSQL database backups. [PDF]
PLoS ONE, 2017 Reducing duplicated data of database backups is an important application scenario for data deduplication technology. NewSQL is an emerging database system and is now being used more and more widely.
Longxiang Wang +4 more
doaj +1 more source
A Content Fingerprint-Based Cluster-Wide Inline Deduplication for Shared-Nothing Storage Systems
IEEE Access, 2020 Deduplication has been principally employed in distributed storage systems to improve storage space efficiency. Traditional deduplication research ignores the design specifications of shared-nothing distributed storage systems such as no central metadata
Awais Khan +2 more
doaj +1 more source
THE USE OF ROUGH CLASSIFICATION AND TWO THRESHOLD TWO DIVISORS FOR DEDUPLICATION
Iraqi Journal for Computers and Informatics, 2023 The data deduplication technique efficiently reduces and removes redundant data in big data storage systems. The main issue is that the data deduplication requires expensive computational effort to remove duplicate data due to the vast size of big data ...
Hashem B. Jehlol, Loay E. George
doaj +1 more source
Double Sliding Window Chunking Algorithm for Data Deduplication in Ocean Observation
IEEE Access, 2023 As an essential means to eliminate redundant data, data deduplication technology significantly affects today’s era of massive data growth. In recent years, due to the rapid development of a series of related industries, such as marine monitoring ...
Shuai Guo +3 more
doaj +1 more source
FASR: An Efficient Feature-Aware Deduplication Method in Distributed Storage Systems
IEEE Access, 2022 Deduplication technology can obtain higher space utilization by keeping only one duplicate. But in a distributed storage system, the overall deduplication ratio will be limited due to redundancy elimination across nodes.
Wenbin Yao +3 more
doaj +1 more source
Research on Routing Strategy in Cluster Deduplication System
IEEE Access, 2021 A cluster deduplication system can coordinate the work of multiple nodes, which can better alleviate the disk index bottleneck existing in the large-scale data backup system.
Qinlu He +5 more
doaj +1 more source
Proceedings of the 4th ACM international workshop on Storage security and survivability, 2008 As the world moves to digital storage for archival purposes, there is an increasing demand for systems that can provide secure data storage in a cost-effective manner. By identifying common chunks of data both within and between files and storing them only once, deduplication can yield cost savings by increasing the utility of a given amount of storage.
Storer, Mark W +3 more
openaire +4 more sources