【分布式】A survey of coded distributed computingCDC综述论文小抄

概述

CDC 编码分布式计算

减少通信负载，减轻掉队的影响，提供容错、隐私和安全

1. 基本原理

2. 基本方案

3. 一些方法

4. 应用

5. 挑战和前景

一、基本原理

分布式模型：

1. Cluster computing

2. Grid computing

3. Cloud computing

因此，最近的研究集中在编码技术上，以克服分布式计算系统的这些实现挑战，其目的是最小化通信负载和减轻散列效应。

主要解决两个问题：

1. To reduce communication load

2. To mitigate the straggler effects

Distributed computation framework:

1. MapReduce: Map, Shuffle, Reduce

2. Spark

3. Dryad

4. CIEL

Communication Load: (这里都是non-coding methods)

提出了不同的Shuffling strategy

Task scheduling algorithms: Quincy scheduler, Hadoop Fair Scheduler, delay scheduling algorithms

Repeating the computation tasks, using the naive replication method

Straggler Effects:

Stragglers: 运行速度慢于平均速度的处理节点

二．Basic CDC schemes

2.1 CDC to minimize communication load

2.2 CDC to mitigate the straggler effects

2.3 Unified CDC Scheme

三．CDC approaches that have been proposed to reduce communication costs.

1. File Allocation

Considering Heterogeneous Systems

Maximizing Data Locality 高数据局部性

Reducing Subpacketization Level

2. Coded Shuffling Design

Compression and randomization

Coding across multiple iterations

Problem-specific coding approaches

3. Consideration of Underlying Network Architecture

4. Function Allocation

四．CDC approaches that have been proposed to mitigate straggler effects.

1. Computation Load Allocation

2. Approximate Coding

3. Exploitation of Stragglers

五、Secure coding for distributed computing

六、CDC Applications

1. NFV

2. Edge Computing 边缘计算

七．Challenges

1. heterogeneous nodes

2. Encoding and decoding complexities

3. Non-static computing nodes

4. Security concerns

5. Network architectures

6. Different computation frameworks

7. Coding for both communication reduction and stragglers mitigation

8. CDC applications