Results 241 to 250 of about 23,686,121 (301)

Data deduplication in a data store [PDF]

, 2014
In our thesis we presented the area of data deduplication and implemented an algorithm for object storage with support for elimination of duplicate chunks within those objects. In the first part we presented storage system as a tree-likestructure of directories and files.
Kovač, Dejan
openaire   +1 more source

Some of the next articles are maybe not open access.

Related searches:

Demystifying data deduplication

Proceedings of the ACM/IFIP/USENIX Middleware '08 Conference Companion, 2008
Effectiveness and tradeoffs of deduplication technologies are not well understood -- vendors tout Deduplication as a "silver bullet" that can help any enterprise optimize its deployed storage capacity. This paper aims to provide a comprehensive taxonomy and experimental evaluation using real-world data.
NagaPramod Mandagere, Pin Zhou, Mark A. Smith, Sandeep Uttamchandani   +3 more
openaire   +1 more source

Distributed data deduplication

Proceedings of the VLDB Endowment, 2016
Data deduplication refers to the process of identifying tuples in a relation that refer to the same real world entity. The complexity of the problem is inherently quadratic with respect to the number of tuples, since a similarity value must be computed for every pair of tuples.
Xu Chu, Ihab F. Ilyas, Paraschos Koutris
openaire   +2 more sources

Transparent Data Deduplication in the Cloud

Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security, 2015
Cloud storage providers such as Dropbox and Google drive heavily rely on data deduplication to save storage costs by only storing one copy of each uploaded file. Although recent studies report that whole file deduplication can achieve up to 50% storage reduction, users do not directly benefit from these savings-as there is no transparent relation ...
Armknecht, Frederik, Bohli, Jens-Matthias, Karame, Ghassan O., Youssef, Franck   +3 more
openaire   +2 more sources

A Global Survey on Data Deduplication

International Journal of Grid and High Performance Computing, 2018
This article describes how data deduplication efficiently eliminates the redundant data by selecting and storing only single instance of it and becoming popular in storage systems. Digital data is growing much faster than storage volumes, which shows the importance of data deduplication among scientists and researchers. Data deduplication is considered
Shubhanshi Singhal, Pooja Sharma, Rajesh Kumar Aggarwal, Vishal Passricha   +3 more
openaire   +1 more source

Data Deduplication Based on Hadoop

2017 Fifth International Conference on Advanced Cloud and Big Data (CBD), 2017
Efficient and scalable deduplication techniques are required to serve the need of removing duplicated data in big data processing platforms such as Hadoop. In this paper, an integrated deduplication approach is proposed by taking the features of Hadoop into acount and leveraging parallelism based on MapReduce and HBase so as to speed up the ...
Dongzhan Zhang, Chengfa Liao, Wenjing Yan, Ran Tao, Wei Zheng 0002   +4 more
openaire   +1 more source

Data Deduplication Techniques and Analysis

2010 3rd International Conference on Emerging Trends in Engineering and Technology, 2010
Data warehouses are the repositories of data collected from several data sources, which form the backbone of most of the decision support applications. As the data sources are independent, they may adopt independent and potentially inconsistent conventions.
Srivatsa Maddodi, Girija V. Attigeri, A. Kotegar Karunakar   +2 more
openaire   +2 more sources

An Overview on Data Deduplication Techniques

2016
The massive data puts forward higher requirements on the capacity of storage devices, but from a practical point of view, the increasement of capacity is far more behind the growth of data. Deduplication technique, for its high efficiency, few resource consumption and extensive application scope, comes to the fore among various data reduction ...
Xuecheng Zhang, Mingzhu Deng
openaire   +1 more source

PerfectDedup: Secure Data Deduplication

2016
With the continuous increase of cloud storage adopters, data deduplication has become a necessity for cloud providers. By storing a unique copy of duplicate data, cloud providers greatly reduce their storage and data transfer costs. Unfortunately, deduplication introduces a number of new security challenges.
Pasquale Puzio, Refik Molva, Melek Önen, Sergio Loureiro   +3 more
openaire   +2 more sources

Data deduplication techniques

2010 International Conference on Future Information Technology and Management Engineering, 2010
With the information and network technology, rapid development, rapid increase in the size of the data center, energy consumption in the proportion of IT spending rising. In the great green environment many companies are eyeing the green store, hoping thereby to reduce the energy storage system.
null Qinlu He, null Zhanhuai Li, null Xiao Zhang   +2 more
openaire   +2 more sources