Evaluating lossy data compression on climate simulation data within a large ensemble [PDF]
Geoscientific Model Development, 2016 High-resolution Earth system model simulations generate enormous data volumes, and retaining the data from these simulations often strains institutional storage resources.
A. H. Baker +14 more
doaj +1 more source
Lossy P-LDPC Codes for Compressing General Sources Using Neural Networks
Entropy, 2023 It is challenging to design an efficient lossy compression scheme for complicated sources based on block codes, especially to approach the theoretical distortion-rate limit. In this paper, a lossy compression scheme is proposed for Gaussian and Laplacian
Jinkai Ren +3 more
doaj +1 more source
Subset-universal lossy compression [PDF]
2015 IEEE Information Theory Workshop (ITW), 2015 To be presented at the 2015 IEEE Information Theory ...
Ordentlich, Or, Shayevitz, Ofer
openaire +2 more sources
Accelerating Parallel Write via Deeply Integrating Predictive Lossy Compression with HDF5 [PDF]
International Conference for High Performance Computing, Networking, Storage and Analysis, 2022 Lossy compression is one of the most efficient solutions to reduce storage overhead and improve I/O performance for HPC applications. However, existing parallel I/O libraries cannot fully utilize lossy compression to accelerate parallel write due to the ...
Sian Jin +6 more
semanticscholar +1 more source
Performance evaluation of lossy quality compression algorithms for RNA-seq data
BMC Bioinformatics, 2020 Background Recent advancements in high-throughput sequencing technologies have generated an unprecedented amount of genomic data that must be stored, processed, and transmitted over the network for sharing.
Rongshan Yu, Wenxian Yang, Shun Wang
doaj +1 more source
Optimally Controllable Perceptual Lossy Compression [PDF]
International Conference on Machine Learning, 2022 Recent studies in lossy compression show that distortion and perceptual quality are at odds with each other, which put forward the tradeoff between distortion and perception (D-P).
Zeyu Yan, Fei Wen, Peilin Liu
semanticscholar +1 more source
Robust image steganography against lossy JPEG compression based on embedding domain selection and adaptive error correction [PDF]
Expert systems with applications, 2023 Transmitting images for communication on social networks has become routine, which is helpful for covert communication. The traditional steganography algorithm is unable to successfully convey secret information since the social network channel will ...
Xiaolong Duan +4 more
semanticscholar +1 more source
A Reliable Data Compression Scheme in Sensor-Cloud Systems Based on Edge Computing
IEEE Access, 2021 The rapid development of the IoT and cloud computing has spawned a new network structure — sensor-cloud system (SCS) where sensors, sensor networks, and cloud computing are integrated to perform data sensing, collection, transmission, and decision
Shaofei Lu +5 more
doaj +1 more source
Optimizing Error-Bounded Lossy Compression for Scientific Data by Dynamic Spline Interpolation
IEEE International Conference on Data Engineering, 2021 Today’s scientific simulations are producing vast volumes of data that cannot be stored and transferred efficiently because of limited storage capacity, parallel I/O bandwidth, and network bandwidth.
Kai Zhao +5 more
semanticscholar +1 more source
Adaptive Configuration of In Situ Lossy Compression for Cosmology Simulations via Fine-Grained Rate-Quality Modeling [PDF]
IEEE International Symposium on High-Performance Parallel Distributed Computing, 2021 Extreme-scale cosmological simulations have been widely used by today's researchers and scientists on leadership supercomputers. A new generation of error-bounded lossy compressors has been used in workflows to reduce storage requirements and minimize ...
Sian Jin +5 more
semanticscholar +1 more source