kafka 复制因子_选择正确的分区计数复制因子apache kafka

kafka 复制因子

A Small Introduction to Kafka!

卡夫卡小介绍！

So before we learn about Kafka, let’s learn how companies start. At first, it’s super simple. You get a source system, and you have a target system and then you need to exchange data. That looks quite simple, right? And then, what happens is, that after a while you have many source systems, and many target systems and they all have to exchange data with one another, and things become really complicated. So the problem is that with a previous architecture

因此，在了解Kafka之前，让我们了解公司的创立方式。 首先，它非常简单。 您有一个源系统，而您有一个目标系统，然后需要交换数据。 看起来很简单，对吧？ 然后，发生的事情是，过了一会儿，您有许多源系统和许多目标系统，并且它们都必须彼此交换数据，事情变得非常复杂。 所以问题是以前的架构

• Each integration comes with difficulties around
  每个集成都伴随着困难

Protocol — how the data is transported (TCP, HTTP, REST, FTP)
Data format — how the data is parsed (Binary, CSV, JSON, Avro)
Data schema & evolution — how the data is shaped and may change

协议-数据的传输方式(TCP，HTTP，REST，FTP) 数据格式-数据的解析方式(二进制，CSV，JSON，Avro) 数据架构和演进-数据的形状和变化方式

• Additionally, each time you integrate a source system with the target system, there will be an increased load from the connections
  此外，每次将源系统与目标系统集成时，连接的负载都会增加

So how do we solve this? Well, this is where Apache Kafka comes in. So Apache Kafka, allows you to decouple your data streams and your systems. So now your source systems will have their data end up in Apache Kafka. While your target systems will source their data straight from Apache Kafka