rdma_RDMA：基本原理和自举探索

rdma

The following article hopes to (i) explain the first principles behind RDMA, a technology producing an order of magnitude performance increase in scale-limited systems (ii) discuss the shift from a “one-size fits all” approach in the assumptions and governance of distributed systems towards application-specific views, (iii) and demonstrate how to quickly bootstrap a cool technology.

吨他下面的文章希望于(i)解释背后RDMA第一的原则，生产的规模限制的系统级的性能提升一个顺序的技术(二)讨论从移位“一一刀切”的假设方法和面向应用程序特定视图的分布式系统治理(iii)，并演示了如何快速引导很酷的技术。

前言：趋势回顾 (Preface: A Review of Trends)

The last decade observed an acceleration in the volume/diversity of I/O devices at the edge of the network and software applications living therein. The symbiotic relationship between the two magnified this trend. As new application layers required novel forms of computing, new hardware was created to adapt to their demands. Likewise, as new hardware evolved, new markets and experiences increased total time spent in the digital world. A tale of two funnels.

在过去的十年中，网络边缘的I / O设备和其中生活的软件应用程序的数量/多样性正在加速增长。 两者之间的共生关系放大了这一趋势。 由于新的应用程序层需要新颖的计算形式，因此创建了新的硬件以适应其需求。 同样，随着新硬件的发展，新市场和新体验也增加了在数字世界中花费的总时间。 两个漏斗的故事。

By example, on the consumer side, the PC was eclipsed by mobile, wearables, and other interfaces now housing ambient computing resources. This opened markets inside homes, on top of watches, and into virtual reality. On the enterprise side, beyond cost improvements, industrial economies adopted specialized IoT devices, CPU chip-makers added hundreds more cores to machines, and GPUs extended their importance in the application layer. Across these two domains, the rise of the sharing-economy, autonomous, gaming, and social media networks increased society’s reliance on the digital world, and in turn, the reliance on these devices powering it.

例如，在消费者方面，PC被移动，可穿戴设备和现在容纳环境计算资源的其他接口所取代。 这打开了房屋内部，手表顶部和虚拟现实的市场。 在企业方面，除了提高成本外，工业经济体还采用了专门的物联网设备，CPU芯片制造商为机器增加了数百个内核，GPU扩展了它们在应用层中的重要性。 在这两个领域中，共享经济，自治，游戏和社交媒体网络的兴起增加了社会对数字世界的依赖，进而增加了对这些数字设备的依赖。

The next decade will accelerate these trends as devices extend beyond mobile and into AR/VR, neural-control interfaces promote bi-directional flows between physical and virtual signals, and increasingly complex applications shift our digital worlds from two-dimensional planes into three-dimensional experiences (hello, the metaverse).

未来十年将加速这些趋势，因为设备将从移动设备扩展到AR / VR，神经控制接口促进物理和虚拟信号之间的双向流动，并且越来越复杂的应用程序将我们的数字世界从二维平面转变为三维经验(你好，元节)。

Scene from “Ready Player One” — a form of the metaverse

来自“ Ready Player One”的场景-一种元宇宙

As a second-order effect, there has been an exponential increase in the volume of information processed and transferred between devices at the edge of the network and their server counterparts. Many companies have outsourced the management of their services to cloud providers wherein economies of scale, specialization of engineering talent, and optionality has created more efficiency. Accordingly, data centers in the public clouds have rapidly scaled and integrated the advancements discussed previously; they have improved general-purpose resources (faster networking hardware, additional CPU cores, etc.) and added specialized hardware to scale bandwidth and computer power. Nonetheless, many core applications –especially those in distributed systems, such as Paxos – still face scalability challenges due to long-standing principles for how servers should communicate with the external world. With the centralization of compute and networks into data centers, engineers are given an opportunity to redefine the governing principles for how agents isolate themselves and share information. As the world becomes more distributed, these innovations within data transfer will be necessary to power the next generation of digital experiences.

作为二阶效应，网络边缘的设备与服务器对应的设备之间处理和传输的信息量呈指数级增长。 许多公司已将其服务管理外包给云提供商，其中规模经济，工程人才的专业化和可选择性提高了效率。 因此，公共云中的数据中心已Swift扩展并整合了先前讨论的进步； 他们改进了通用资源(更快的网络硬件，附加的CPU内核等)，并添加了专用硬件来扩展带宽和计算机功能。 但是，由于服务器应如何与外部世界通信的长期原则，许多核心应用程序-尤其是分布式系统(如Paxos)中的应用程序仍面临可伸缩性挑战。 通过将计算和网络集中到数据中心，工程师有机会重新定义代理如何隔离自身和共享信息的管理原则。 随着世界变得越来越分散，数据传输中的这些创新对于推动下一代数字体验至关重要。

RDMA简介 (Introduction to RDMA)

Traditional networking protocols, specifically TCP/IP, limit the number of active, concurrent connections due to bottlenecks in (i) OS kernels and (ii) processing the protocol itself. They implement a two-sided model: a sender copies and transfers data over the network to some receiver, who acts upon t