hadoop
文章平均质量分 81
5icode.top
https://5icode.top
https://5icode.top
展开
-
yum
[root@MasterHadoop50 ~]# yum install autoconf automake libtoolLoaded plugins: fastestmirror, securityLoading mirror speeds from cached hostfileCould not retrieve mirrorlist http://mirrorlist.cen原创 2014-12-21 14:23:23 · 945 阅读 · 0 评论 -
hadoop-mapreduce-examples
hadoop jar ./share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0-cdh5.1.0.jar pi 2 5[root@name01 cmake-2.8.12.2]# hadoop versionHadoop 2.3.0-cdh5.1.0Subversion git://github.sf.cloudera.com/CDH/原创 2016-06-13 13:14:54 · 3888 阅读 · 1 评论 -
hdfs dfs -ls 命令
Connecting to 192.168.111.242:22...Connection established.To escape to local shell, press 'Ctrl+Alt+]'.Last login: Fri Jun 17 09:24:06 2016 from 192.168.111.186[root@bigdata242 ~]# hdfs dfs -ls-原创 2016-06-17 09:31:53 · 7309 阅读 · 2 评论 -
SSH error:a public key file has not been specified by this session
可能是SSH客户端没有开启密码验证,或者SSH服务端不允许密码验证。服务端开启密码验证的方法:修改/etc/ssh/sshd_config的PasswordAuthentication项为yes,重启服务($service sshd restart)原创 2016-07-03 17:32:42 · 2530 阅读 · 0 评论 -
spark worker 启动失败 failed to launch org.apache.spark.deploy.worker.Worker
failed to launch org.apache.spark.deploy.worker.Worker原创 2016-06-18 00:08:33 · 14674 阅读 · 1 评论 -
克隆centos虚拟机 的IP HostName HWaddr
克隆centos虚拟机 的IP HostName HWaddr原创 2016-06-18 00:11:22 · 850 阅读 · 0 评论 -
Hadoop启动,创建文件hdfs
Hadoop启动,创建文件hdfs原创 2016-06-18 00:13:42 · 1671 阅读 · 0 评论 -
ping: unknown host www.baidu.com
ping: unknown host www.baidu.com原创 2016-07-19 01:04:02 · 2391 阅读 · 0 评论 -
hadoop dfsadmin -report failed
[root@cdh1 sshlocal]# hadoop dfsadmin -reportDEPRECATED: Use of this script to execute hdfs command is deprecated.Instead use the hdfs command for it.report: Call From cdh1/192.168.3.110 to cdh1:9000 failed on connection exception: java.net.ConnectExce原创 2016-07-19 01:06:31 · 2257 阅读 · 0 评论 -
hadoop jps 进程显示不全
hadoop jps 显示 不全原创 2016-07-19 22:43:45 · 11477 阅读 · 1 评论 -
make check
[root@name01 protobuf-2.5.0]# make checkMaking check in .make[1]: Entering directory `/usr/local/protobuf/protobuf-2.5.0'make check-localmake[2]: Entering directory `/usr/local/protobuf/protobuf-原创 2016-06-13 13:06:28 · 2112 阅读 · 2 评论 -
Unable to load native-hadoop library for your platform,编译
Unable to load native-hadoop library for your platform,编译h (2014-03-11 15:37:26)转载▼标签: hadoop hadoop2.2.0 native-hadoop 编译 教育 转自:http://programonkey.com/blog/?p=25问题:在运行hadoop的时候,出现警告:WARN util.转载 2016-06-13 13:05:35 · 464 阅读 · 0 评论 -
hadoop namenode -format Couldn'tload main class "-Djava.library.path=.home.hadoop.hadoop-2.5.2.lib"
[hadoop@MasterHadoop50 ~]$ hadoop namenode -formatDEPRECATED: Use of this script to execute hdfs command is deprecated.Instead use the hdfs command for it.Error: Could not find or load main class原创 2014-12-21 12:02:28 · 3104 阅读 · 0 评论 -
hive 入门
ok原创 2016-06-10 15:58:09 · 349 阅读 · 0 评论 -
hive-0
ok原创 2016-06-10 15:59:47 · 710 阅读 · 0 评论 -
Datanode JPS
ok原创 2016-06-10 23:42:06 · 519 阅读 · 0 评论 -
hive 元数据 mysql-1
[root@name01 hdfs]# jps2913 SecondaryNameNode3538 RunJar3061 ResourceManager2742 DataNode2650 NameNode3772 Jps3151 NodeManager[root@name01 hdfs]# mysql -u root -pbash: mysql: command not foun原创 2016-06-11 09:39:01 · 617 阅读 · 0 评论 -
hive 元数据 mysql-2
[root@name01 hdfs]# cd /data/hadoop/tmp/[root@name01 tmp]# rm -rf *[root@name01 tmp]# cd /data/hadoop/name/[root@name01 name]# rm -rf *[root@name01 name]# cd /data/hadoop/data/[root@name01 dat原创 2016-06-11 09:39:41 · 1100 阅读 · 1 评论 -
spark 启动
[root@name01 conf]# pwd/usr/local/spark/spark-1.4.0/conf[root@name01 conf]# ../sbin/start-dfs.shbash: ../sbin/start-dfs.sh: No such file or directory[root@name01 conf]# lsdocker.properties.templa原创 2016-06-11 12:58:09 · 2936 阅读 · 0 评论 -
scala 初始化
hive (default)> create database ecdata WITH DBPROPERTIES ('creator' = 'June', 'date' = '2014-06-01');OKTime taken: 0.089 secondshive (default)> show databases;原创 2016-06-11 12:59:33 · 3312 阅读 · 0 评论 -
profile
#Hadoop Envexport HADOOP_HOME_WARN_SUPPRESS=1export JAVA_HOME=/user/local/jdk#export HADOOP_HOME=/user/local/hadoop#export PATH=$JAVA_HOME/bin:$HADOOP_HOME:/bin:$PATHexport PATH=$JAVA_HOME/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$PATH#Hadoop Envexpo原创 2016-06-29 07:51:17 · 625 阅读 · 0 评论 -
(1)ping www.baidu.com [ping: unknown host www.baidu.com]---(2)xshell 连接虚拟机问题---(3) 网卡重启失败
---(1)ping www.baidu.com [ping: unknown host www.baidu.com]---(2)xshell 连接虚拟机问题---(3) 网卡重启失败原创 2016-07-19 22:51:15 · 11547 阅读 · 1 评论