在运行spark-shell时,会出现以下警告,但是不影响正常运行:
WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
解决办法:
修改spark/conf/spark-env.sh文件,添加如下内容:
export LD_LIBRARY_PATH=$HADOOP_HOME/lib/native