ssh提交 hadoop集群

连接学校vpn

---

打包jar

https://blog.csdn.net/yuzhuzhong/article/details/51654717

---

ssh

ssh 201700301147@10.102.0.197

将文件上传集群文件系统需切换到另一终端
scp /home/hadoop/apriori.jar 201700301147@10.102.0.197:/home/201700301147

将文件传回本机文件系统需切换到另一终端
scp 201700301147@10.102.0.197:/home/201700301147/part-r-00000  /home/goodman/result

---

hdfs命令(在SSH运行的那个终端执行)

创建目录
hadoop dfs -mkdir /user/201700301147/apriori2

删除目录
hadoop dfs -rm -r aprioir

遍历
hadoop dfs -ls /user/201700301147

集群文件系统上传集群HDFS
hdfs dfs -put BX-Book-Ratings.txt /user/201700301147/apriori2

集群HDFS传回集群文件系统
hadoop dfs -get /user/201700301147/apriori/FreqItemSetOutput2/part-r-00000

---

集群运行

hadoop jar apriori.jar (如jar包生成过程中没指定运行类，则还需要在此处指定)