【NSDI 2020】Diamond-Miner: Comprehensive Discovery of the Internet‘s Topology Diamonds

背景

Despite the well-known existence of load-balanced forwarding paths in the Internet, current active topology Internet-wide mapping efforts are multipath agnostic – largely because of the probing volume and time required for existing multipath  discovery techniques.

众所周知，网络中存在负载平衡的转发路径，但在全网范围内，当前的主动的拓扑映射工作是多路径不可知的，这主要是因为现有的多路径发现技术需要探测量和时间。

基本思想

This paper introduces D-Miner, a system that marries previous work on high-speed probing with multipath discovery to make Internet-wide topology mapping,inclusive of load-balanced paths, feasible.

本文介绍了D-Miner，这是一个将先前的高速探测与多路径发现相结合的系统，使包括负载平衡路径在内的全互联网拓扑映射成为可能。

D-Miner is designed to capture Internet topology snapshots inclusive of all load-balanced paths. At its heart, D-Miner uses Yarrp’s randomized and stateless probing to achieve high probing rates. To this, it adds probe set generation logic that keeps track, on a per-node basis, of whether all outbound loadbalanced edges have been discovered with high probability.The logic guides Yarrp through multiple rounds until the full discovery criterion has been satisfied for almost all nodes.

D-Miner被设计用来捕捉互联网拓扑快照，包括所有负载平衡路径。其核心是，D-Miner使用Yarrp的随机和无状态探测来实现高探测率。除此之外，它还添加了探测集生成逻辑，以每个节点为基础跟踪所有出站负载平衡边缘是否都以高概率。那个逻辑引导Yarrp进行多轮搜索，直到几乎所有节点都满足完整的发现标准。

结果

We deploy D-Miner and collect multiple IPv4 interface-level topology snapshots, where we find >64% more edges, and significantly more complex topologies relative to existing systems. We further scrutinize topological changes between snapshots and attribute forwarding differences not to routing or policy changes, but to load balancer “remapping” events. We precisely categorize remapping events and find that they are a much more frequent contributor of path changes than previously recognized.By making D-Miner and our collected Internet-wide topologies publicly available, we hope to help facilitate better understanding of the Internet’s true structure and resilience.