Mysql CDC连接

1错误

Caused by: Could not fulfill slot request 94ac1d30407079d0af24fbac942e6377. Requested resource profile (ResourceProfile{UNKNOWN}) is unfulfillable.

Caused by: No pooled slot available and request to ResourceManager for new slot failed

解决

flink config设置

taskmanager memory process size = 5000

2错误

Caused by: Incremental snapshot for tables requires primary key, but table seatunnel.day_test doesn't have primary key.

解决

表里添加主键 prinary key

3错误

Caused by: com.mysql.cj.CharsetMapping.getStaticJavaEncodingForMysqlCharset(Ljava/lang/String;)Ljava/lang/String;

Caused by: One or more fetchers have encountered exception

解决

更换mysql-connector-java-8.0.11.jar包，更换为mysql-connector-java-8.0.30.jar

cd /seatunnel/apache-seatunnel-incubating-2.3.0/plugins/jdbc/lib

删除原本的jar，上传mysql-connector-java-8.0.30.jar

4错误

Caused by: java.lang.RuntimeException: 
        at org.apache.seatunnel.translation.source.ParallelReaderContext.sendSourceEventToEnumerator(ParallelReaderContext.java:61)
        at org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceReader.reportFinishedSnapshotSplitsIfNeed(IncrementalSourceReader.java:150)
        at org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceReader.onSplitFinished(IncrementalSourceReader.java:137)
        at org.apache.seatunnel.connectors.seatunnel.common.source.reader.SourceReaderBase.finishCurrentFetch(SourceReaderBase.java:193)
        at org.apache.seatunnel.connectors.seatunnel.common.source.reader.SourceReaderBase.moveToNextSplit(SourceReaderBase.java:170)
        at org.apache.seatunnel.connectors.seatunnel.common.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:157)
        at org.apache.seatunnel.connectors.seatunnel.common.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:91)
        at org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceReader.pollNext(IncrementalSourceReader.java:94)
        at org.apache.seatunnel.connectors.seatunnel.common.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:111)
        at org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceReader.pollNext(IncrementalSourceReader.java:94)
        at org.apache.seatunnel.translation.source.ParallelSource.run(ParallelSource.java:128)
        at org.apache.seatunnel.translation.flink.source.BaseSeaTunnelSourceFunction.run(BaseSeaTunnelSourceFunction.java:83)
        at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:110)
        at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:66)
        at org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:263)

解决

了解到的是，可能是由于程序代码中的错误，或者是由于系统资源不足或其他原因导致的错误

代码是默认的没改过的，再根据运行时看free -m内存，发现运行时，内存剩余小于900，任务挂掉内存回归1300左右，目前怀疑是因为内存不够