Setting up Kinesis source Connector with AWS MSK
-
Launch an EC2 instance:
I tested on an Ubuntu instance v16.04
-
Install Java:
$ sudo apt-get update
$ sudo apt-get install default-jre
- Install Confluent platform:
Make sure to install the ConfluentPlatform version 5.1.0 as it comes with Kafka v2.1.0 compatible with the kafka version on AWS MSK
Download and extract the 5.1.0 tarball from the link: https://www.confluent.io/previous-versions/
- Install the Confluent Hub:
Download and Unzip the tar given in the doc here: https://docs.confluent.io/current/connect/managing/confluent-hub/client.html
Set the PATH environment va