Results 1 to 10 of about 20,914 (161)
A study of practical deduplication [PDF]
ACM Transactions on Storage, 2012 We collected file system content data from 857 desktop computers at Microsoft over a span of 4 weeks. We analyzed the data to determine the relative efficacy of data deduplication, particularly considering whole-file versus block-level elimination of redundancy.
William J Bolosky +2 more
exaly +3 more sources
Enhancing Transparency, Auditability, and Reproducibility of Deduplication in Systematic Reviews: Tutorial for the Rayyan Method and Systematic Auto Resolver [PDF]
Interactive Journal of Medical ResearchDeduplication across search results is one of the earliest and most critical steps in the systematic review methodological process; yet, existing solutions often lack the transparency, auditability, and reproducibility required by rigorous systematic ...
Mimi M Kim +4 more
doaj +2 more sources
Large-scale geocoding via iterative deduplication: Building a unified address database in Brazil with CIDACS-RL [PDF]
International Journal of Population Data ScienceThis work aims to construct a dataset of unique addresses from Brazilian administrative, socioeconomic, and health databases. We assess the potential of iterative deduplication to generate a parent-duplicate data structure that supports address ...
Robespierre Pita +9 more
doaj +2 more sources
THE USE OF ROUGH CLASSIFICATION AND TWO THRESHOLD TWO DIVISORS FOR DEDUPLICATION
Iraqi Journal for Computers and Informatics, 2023 The data deduplication technique efficiently reduces and removes redundant data in big data storage systems. The main issue is that the data deduplication requires expensive computational effort to remove duplicate data due to the vast size of big data ...
Hashem B. Jehlol, Loay E. George
doaj +1 more source
Using an Alternative Method to Estimate Overcount for Census 2021.
International Journal of Population Data Science, 2022 Objectives The project aimed to test an alternative method to estimate the number of duplicate responses in the 2021 England and Wales Census. The method utilises information from all census records instead of relying on samples.
Zoe White +2 more
doaj +1 more source
Secure EMR Classification and Deduplication Using MapReduce
IEEE Access, 2022 Healthcare providers generate huge amount of data every day through registration, lab results, prescriptions, and others. This is stored in the form of Electronic Medical Records (EMR) in a central repository.
A. V. Usharani, Girija Attigeri
doaj +1 more source
Data Deduplication With Random Substitutions [PDF]
IEEE Transactions on Information Theory, 2020 Data deduplication saves storage space by identifying and removing repeats in the data stream. Compared with traditional compression methods, data deduplication schemes are more time efficient and are thus widely used in large scale storage systems.
Hao Lou, Farzad Farnoud
openaire +4 more sources
Research on Data Routing Strategy of Deduplication in Cloud Environment
IEEE Access, 2022 The application of data deduplication technology reduces the demand for data storage and improves resource utilization. Compared with limited storage capacity and computing capacity of a single node, cluster data deduplication technology has great ...
Qinlu He +6 more
doaj +1 more source
A Record Linkage-Based Data Deduplication Framework with DataCleaner Extension
Multimodal Technologies and Interaction, 2022 The data management process is characterised by a set of tasks where data quality management (DQM) is one of the core components. Data quality, however, is a multidimensional concept, where the nature of the data quality issues is very diverse.
Otmane Azeroual +5 more
doaj +1 more source
Frontiers in Drug Safety and Regulation, 2022 The US Food and Drug Administration (FDA) receives millions of postmarket adverse event reports for drug and therapeutic biologic products every year.
Kory Kreimeyer +7 more
doaj +1 more source