Results 261 to 270 of about 2,707,814 (314)

Efficient Fault Tolerance for Recommendation Model Training via Erasure Coding

Proceedings of the VLDB Endowment, 2023
Deep-learning-based recommendation models (DLRMs) are widely deployed to serve personalized content. In addition to using neural networks, DLRMs have large, sparsely-accessed embedding tables, which map categorical features to a learned dense ...
Tianyu Zhang, Kaige Liu, J. Kosaian, Juncheng Yang, R. Vinayak   +4 more
semanticscholar   +1 more source

Minimizing Network and Storage Costs for Consensus with Flexible Erasure Coding

International Conference on Parallel Processing, 2023
Consensus protocols like Paxos and Raft provide data consistency and fault tolerance for upper-layer distributed services. Log replication in these protocols can be supported by erasure coding, which incurs a lower redundancy ratio than full-copy ...
Mi Zhang, Qihan Kang, Patrick P. C. Lee
semanticscholar   +1 more source

KVRAID: high performance, write efficient, update friendly erasure coding scheme for KV-SSDs

Annual Haifa Experimental Systems Conference, 2021
Key-value (KV) stores have been widely deployed in a variety of scale-out enterprise applications such as online retail, big data analytics, social networks, etc.
Mian Qin, A. Reddy, Paul V. Gratz, Rekha Pitchumani, Y. Ki   +4 more
semanticscholar   +1 more source

Enabling Efficient and Reliable Transition from Replication to Erasure Coding for Clustered File Systems

IEEE Transactions on Parallel and Distributed Systems, 2017
Runhui Li, Yuchong Hu, P. Lee
semanticscholar   +3 more sources

BFT-Store: Storage Partition for Permissioned Blockchain via Erasure Coding

IEEE International Conference on Data Engineering, 2020
The full-replication data storage mechanism, as commonly utilized in existing blockchain systems, is lack of sufficient storage scalability, since it reserves a copy of the whole block data in each node so that the overall storage consumption per block ...
Xiaodong Qi, Zhao Zhang, Cheqing Jin, Aoying Zhou   +3 more
semanticscholar   +1 more source

INEC: Fast and Coherent In-Network Erasure Coding

International Conference for High Performance Computing, Networking, Storage and Analysis, 2020
Erasure coding (EC) is a promising fault tolerance scheme that has been applied to many well-known distributed storage systems. The capability of Coherent EC Calculation and Networking on modern SmartNICs has demonstrated that EC will be an essential ...
Haiyang Shi, Xiaoyi Lu
semanticscholar   +1 more source

Windowed Erasure Codes

2006 IEEE International Symposium on Information Theory, 2006
The design of erasure correcting codes and their decoding algorithms is now at the point where capacity achieving codes are available with decoding algorithms that have complexity that is linear in the number of information symbols. One aspect of these codes is that the overhead (number of coded symbols beyond the number of information symbols required
Chris Studholme, Ian Blake
openaire   +1 more source

EC-Fusion: An Efficient Hybrid Erasure Coding Framework to Improve Both Application and Recovery Performance in Cloud Storage Systems

IEEE International Parallel and Distributed Processing Symposium, 2020
Nowadays erasure coding is one of the most significant techniques in cloud storage systems, which provides both quick parallel I/O processing and high capabilities of fault tolerance on massive data accesses.
Han Qiu, Chentao Wu, Jie Li, M. Guo, Tong Liu, Xubin He, Yuanyuan Dong, Yafei Zhao   +7 more
semanticscholar   +1 more source

Erasure Decoding for Gabidulin Codes

Journal of Mathematical Modelling and Algorithms, 2011
zbMATH Open Web Interface contents unavailable due to conflicting licenses.
Babindamana, Regis F., Gueye, Cheikh Thiecoumba   +1 more
openaire   +2 more sources

Towards In-network Acceleration of Erasure Coding

ACM SIGCOMM Symposium on Software Defined Networking Research, 2020
In distributed storage systems, erasure coding (EC) is a crucial technology to enable high fault tolerance with lower storage overheads than data replication. EC can reconstruct missing data by downloading parity data from survived machines.
Yi Qiao, Xiao Kong, Menghao Zhang, Yu Zhou, Mingwei Xu, J. Bi   +5 more
semanticscholar   +1 more source