python连接clickhouse数据插入OSError: [Errno 22] Invalid argument异常

背景

python连接clickhouse插入数据异常，报错信息如下：

Traceback (most recent call last):
  File "D:\workspace\zcm_docScript\venv\lib\site-packages\clickhouse_connect\driver\transform.py", line 96, in chunk_gen
    col_type.write_column(data, output, context)
  File "D:\workspace\zcm_docScript\venv\lib\site-packages\clickhouse_connect\datatypes\base.py", line 187, in write_column
    self.write_column_data(column, dest, ctx)
  File "D:\workspace\zcm_docScript\venv\lib\site-packages\clickhouse_connect\datatypes\base.py", line 202, in write_column_data
    self._write_column_binary(column, dest, ctx)
  File "D:\workspace\zcm_docScript\venv\lib\site-packages\clickhouse_connect\datatypes\temporal.py", line 135, in _write_column_binary
    column = [int(x.timestamp()) if x else 0 for x in column]
  File "D:\workspace\zcm_docScript\venv\lib\site-packages\clickhouse_connect\datatypes\temporal.py", line 135, in <listcomp>
    column = [int(x.timestamp()) if x else 0 for x in column]
OSError: [Errno 22] Invalid argument

原因分析

ck中DateTime类型，取值范围必须大于1970-01-01，如果插入的数据有小于这个机器元年的数据，则会报出上述异常。
另：DateTime64的起始时间为1900-01-01
详情请移步官网详细说明。
DateTime64

解决方案

1， 将默认的时间占位符提前到1970-01-01之后，对于小于该时间的其他脏数据，也需要更新到这个时间之后。

2，将DateTime类型字段改为DateTime64，解决部分问题。