java.io.FileNotFoundException (Too many open files)

今天kafka集群报错，查看日志提示

[2018-07-18 17:34:02,672] ERROR Error while rolling log segment for PREPROCESS in dir /mnt/sdc (kafka.server.LogDirFailureChannel)
java.io.FileNotFoundException: /mnt/sdc/PREPROCESS/00000000000000000000.index (Too many open files)
    at java.io.RandomAccessFile.open(Native Method)
    at java.io.RandomAccessFile.<init>(RandomAccessFile.java:243)
    at kafka.log.AbstractIndex$$anonfun$resize$1.apply(AbstractIndex.scala:105)
    at kafka.log.AbstractIndex$$anonfun$resize$1.apply(AbstractIndex.scala:104)
    at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:217)
    at kafka.log.AbstractIndex.resize(AbstractIndex.scala:104)
    at kafka.log.AbstractIndex$$anonfun$trimToValidSize$1.apply$mcV$sp(AbstractIndex.scala:163)
    at kafka.log.AbstractIndex$$anonfun$trimToValidSize$1.apply(AbstractIndex.scala:163)
    at kafka.log.AbstractIndex$$anonfun$trimToValidSize$1.apply(AbstractIndex.scal