IllegalArgumentException: Magic v1 does not support record headers

最近Consumer消费Kafka数据时报错：

java.lang.IllegalArgumentException: Magic v1 does not support record headers

kafka-client version: 0.10.2

kafka-server version: 1.1.0

原因：

if these messages have headers ([KAFKA-4208] Add Record Headers - ASF JIRA), you will need to use Kafka 0.11+ to consume them as old Kafka client cannot read such messages. If so, you can use the following command:

/usr/local/spark/bin/spark-submit --packages "org.apache.kafka:kafka-clients:0.11.0.3,org.apache.spark:spark-sql-kafka-0-10_2.11:2.3.1"
myjar.jar

参考： spark streaming kafka : Unknown error fetching data for topic-partition - Stack Overflow

解决方案：kafka-client 升级到0.11.+即可。