问题:
pip安装pydoop的时候报错:
This will solve error pydoop.LocalModeNotSupported: ERROR: Hadoop is configured to run in local mode
解决:
编辑hadoop的配置文件:
<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
</configuration>