A Survey on Error-Bounded Lossy Compression for Scientific Datasets [PDF]
ACM Computing SurveysError-bounded lossy compression has been effective in significantly reducing the data storage/transfer burden while preserving the reconstructed data fidelity very well.
S. Di +24 more
semanticscholar +3 more sources
QVZ: lossy compression of quality values. [PDF]
Bioinformatics, 2018 Abstract Motivation Recent advancements in sequencing technology have led to a drastic reduction in the cost of sequencing a genome. This has generated an unprecedented amount of genomic data that must be stored, processed and transmitted.
Malysa G +5 more
europepmc +7 more sources
Thouless-Anderson-Palmer Approach for Lossy Compression [PDF]
Physical Review E, 2003 We study an ill-posed linear inverse problem, where a binary sequence will be reproduced using a sparce matrix. According to the previous study, this model can theoretically provide an optimal compression scheme for an arbitrary distortion level, though ...
C.E. Shannon +6 more
core +3 more sources
Learning Better Lossless Compression Using Lossy Compression [PDF]
2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020 We leverage the powerful lossy image compression algorithm BPG to build a lossless image compression system. Specifically, the original image is first decomposed into the lossy reconstruction obtained after compressing it with BPG and the corresponding ...
Fabian Mentzer +2 more
semanticscholar +5 more sources
Remote Sensing, 2021 Lossy compression of remote sensing data has found numerous applications. Several requirements are usually imposed on methods and algorithms to be used.
Victor Makarichev +5 more
doaj +2 more sources
The Cosmos and Crystal Connection: What We Can Learn About Data Compression [PDF]
Structural DynamicsWe use both lossy and lossless compression methods to reduce large amounts of digital data, making it easier to store and manage. Lossy and lossless compression is frequently used in astronomy, to condense the large amount of data collected by ...
Kimberly M. Horvat +3 more
doaj +2 more sources
Massive compression for high data rate macromolecular crystallography (HDRMX): impact on diffraction data and subsequent structural analysis [PDF]
Journal of Synchrotron RadiationNew higher-count-rate, integrating, large-area X-ray detectors with framing rates as high as 17400 images per second are beginning to be available.
Herbert J. Bernstein +3 more
doaj +2 more sources
Lossy compression of Earth system model data based on a hierarchical tensor with Adaptive-HGFDR (v1.0) [PDF]
Geoscientific Model Development, 2021 Lossy compression has been applied to the data compression of large-scale Earth system model data (ESMD) due to its advantages of a high compression ratio.
Z. Yu +10 more
doaj +1 more source
High-performance Effective Scientific Error-bounded Lossy Compression with Auto-tuned Multi-component Interpolation [PDF]
Proc. ACM Manag. Data, 2023 Error-bounded lossy compression has been identified as a promising solution for significantly reducing scientific data volumes upon users' requirements on data distortion. For the existing scientific error-bounded lossy compressors, some of them (such as
Jinyang Liu +9 more
semanticscholar +1 more source
Lossy Compression with Gaussian Diffusion [PDF]
arXiv.org, 2022 We consider a novel lossy compression approach based on unconditional diffusion generative models, which we call DiffC. Unlike modern compression schemes which rely on transform coding and quantization to restrict the transmitted information, DiffC ...
Lucas Theis +3 more
semanticscholar +1 more source