Results 151 to 160 of about 4,462 (194)

X-RDMA: Effective RDMA Middleware in Large-scale Production Environments

2019 IEEE International Conference on Cluster Computing (CLUSTER), 2019
X-RDMA is a communication middleware deployed and heavily used in Alibaba’s large-scale cluster hosting cloud storage and database systems. Unlike recent research projects which purely focus on squeezing out the raw hardware performance, it puts emphasis on robustness, scalability and maintainability of large-scale production clusters.
Teng Ma, Tao Ma, Zhuo Song, Jingxuan Li, Huaixin Chang, Kang Chen, Hai Jiang, Yongwei Wu   +7 more
openaire   +1 more source

AcceleratingWeb Protocols Using RDMA

Sixth IEEE International Symposium on Network Computing and Applications (NCA 2007), 2007
High-performance computing, just like the world at large, is continually discovering new uses for the Internet. Interesting applications rely on server-generated content, severely taxing the capabilities of web servers. Thus it is common for multiple servers to run a single site.
Dennis Dalessandro, Pete Wyckoff
openaire   +1 more source

Breaking the Connection: RDMA Deconstructed

13th Symposium on High Performance Interconnects (HOTI'05), 2006
The architecture, design and performance of RDMA (remote direct memory access) over the IBM HPS (high performance switch and adapter) are described. Unlike conventional implementations such as InfiniBand, our RDMA transport model is layered on top of an unreliable datagram interface, while leaving the task of enforcing reliability to the ULP (upper ...
R. Sivaram, R.K. Govindaraju, P. Hochschild, R. Blackmore, P. Chaudhary   +4 more
openaire   +1 more source

RDMA Capable iWARP over Datagrams

2011 IEEE International Parallel & Distributed Processing Symposium, 2011
iWARP is a state of the art high-speed connection-based RDMA networking technology for Ethernet networks to provide InfiniBand-like zero-copy and one-sided communication capabilities over Ethernet. Despite the benefits offered by iWARP, many data center and web-based applications, such as stock-market trading and media-streaming applications, that rely
Ryan E. Grant, Mohammad J. Rashti, Ahmad Afsahi, Pavan Balaji   +3 more
openaire   +1 more source

Accelerating Spark Shuffle with RDMA

2018 IEEE International Conference on Networking, Architecture and Storage (NAS), 2018
Apache Spark is a lightning-fast unified analytics engine for large-scale data processing. When executing an ap­plication with Spark, it runs many jobs in parallel. These jobs are divided into stages based on the shuffle boundary. However, shuffling data across the stages in a cluster is time-consuming because it will place significant burden on ...
Bing Liu, Fang Liu, Nong Xiao, Zhiguang Chen   +3 more
openaire   +1 more source

PART: Pinning Avoidance in RDMA Technologies

2020 14th IEEE/ACM International Symposium on Networks-on-Chip (NOCS), 2020
State-of-the-art Remote Direct Memory Access (RDMA) engines pin communication buffers, complicating the programming model, limiting the memory utilization, and mandating a separate memory translation subsystem spanning the network interface card and the OS.
Antonis Psistakis, Nikos Chrysos, Fabien Chaix, Marios Asiminakis, Michalis Giannioudis, Pantelis Xirouchakis, Vassilis Papaefstathiou, Manolis Katevenis   +7 more
openaire   +1 more source

Performance Isolation Anomalies in RDMA

Proceedings of the Workshop on Kernel-Bypass Networks, 2017
To meet the increasing throughput and latency demands of modern applications, many operators are rapidly deploying RDMA in their datacenters. At the same time, developers are re-designing their software to take advantage of RDMA's benefits for individual applications.
Yiwen Zhang, Juncheng Gu, Youngmoon Lee, Mosharaf Chowdhury, Kang G. Shin   +4 more
openaire   +1 more source

RDMA-based dataflow management system

2017 IEEE First Ukraine Conference on Electrical and Computer Engineering (UKRCON), 2017
A system to control the data flow between detector sensors input streams for the data connected with a single event is elaborated. Obtained results show that a High Performance Computing cluster data exchange can be efficient AND fault-tolerant.
openaire   +1 more source

RDMA Load Balancing via Data Partition

2019 28th International Conference on Computer Communication and Networks (ICCCN), 2019
With the development of data center networks, traditional TCP/IP cannot support the demand in data centers. Remote Direct Memory Access (RDMA) technology could improve the performance of DCN significantly because of high throughput and low latency. However, load balancing is a key issue in RDMA which has not been solved distribute.
Yi Wang, Ya-nan Jiang, Qiufang Ma, Chen Tian, Bo Bai, Gong Zhang   +5 more
openaire   +1 more source

Minimizing the Hidden Cost of RDMA

2009 29th IEEE International Conference on Distributed Computing Systems, 2009
Remote Direct Memory Access (RDMA) is a mechanism whereby data is moved directly between the application memory of the local and remote computer. In bypassing the operating system, RDMA significantly reduces the CPU cost of large data transfers and eliminates intermediate copying across buffers, thereby making it very attractive for implementing ...
Philip Werner Frey, Gustavo Alonso
openaire   +1 more source