自有贵人相助

http://www.cnblogs.com/xia520pi/archive/2012/04/08/2437875.html

hotshttp://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.9.1/bk_installing_manually_book/content/rpm-chap1-11.html

sqoop import --connect jdbc:mysql://ip:3306/库名 --table 表名 --username 用户名 --password 密码异常:14/03/26 13:31:34 INFO sqoop.Sqoop: Running Sqoop version: 1.4.3-cdh4.5.014/03/26 13:31:34 WARN tool.Base

hadoop job 重要性能参数mapred.task.profile是否对任务进行profiling，调用java内置的profile功能，打出相关性能信息mapred.task.profile.{maps|reduces}对几个map或reduce进行profiling。非常影响速度，建议在小数据量上尝试mapred.job.reuse.jvm.num.tasks

http://dongxicheng.org/mapreduce-nextgen/hadoop-2-0-jobhistory-log/

一、安装lzop:yum -y install lzop二、安装lzo1、wget http://www.oberhumer.com/opensource/lzo/download/lzo-2.06.tar.gz2、tar -zxvf lzo-2.06.tar.gz3、mv lzo-2.06 lzo && cd lzo4、export CFLAGS=-m645、./

1、创建hadoop用户【所有操作都是root,在所有master和slaver上】1)、创建hadoop用户：adduser hadoop2)、更换密码:passwd hadoop====================================================================================2、安装jdk【所有操作都是roo

1、下载mahout:http://archive.cloudera.com/cdh4/cdh/4/mahout-0.7-cdh4.6.0.tar.gz2、解压:mahout-0.7-cdh4.5.0.tar.gz3、改名:mv mahout-0.7-cdh4.5.0 mahout4、添加环境变量/tec/profile:export MAHOUT_HOME=/usr/local/

1、下载sqoop到/usr/local:wget http://archive.cloudera.com/cdh4/cdh/4/sqoop-1.4.3-cdh4.6.0.tar.gz2、解压:tar -zxvf sqoop-1.4.3-cdh4.6.0.tar.gz3、重命名:mv sqoop-1.4.3-cdh4.6.0 sqoop4、添加环境变量/etc/profile:ex

sqoop2-1.99.2-cdh4.5.0在安装过程中遇到各种NoClassDefFoundError异常，例如:Exception sending context initialized event to listener instance of class org.apache.sqoop.server.ServerInitializerjava.lang.NoClassDefFou

异常:Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/sqoop/SqoopCaused by: java.lang.ClassNotFoundException: org.apache.sqoop.Sqoop        at java.net.URLClassLoader$1.run(UR