Sqoop
ylzhjlinux
这个作者很懒,什么都没留下…
展开
-
sqoop1:import to hive with comma delimilated fields
I want to import data with tree fileds from mysql table to hdfs with hive metastore integaration. I want to the data format stored in hdfs likesfield1,field2,field3....which these fileds in a ...原创 2014-05-15 09:27:15 · 92 阅读 · 0 评论 -
sqoop1: import to hive partitioned table
mysql table user hive metastore table sqoop import scripts import --verbose --connect jdbc:mysql://192.168.122.1:3306/sample --username zhaohj --password 123456 --table user --spli...原创 2014-04-22 11:13:10 · 450 阅读 · 0 评论 -
Sqoop1: 1.4.4 commands list getted from log
usage: sqoop import [GENERIC-ARGS] [TOOL-ARGS]Common arguments: --connect <jdbc-uri> Specify JDBC connect string --connection-manager <class-name> ...原创 2014-04-14 09:46:10 · 65 阅读 · 0 评论 -
Sqoop1: Sqoop-HCatalog Integration
I create a HCat table using Hue metastore manager, and submit a sqoop job with hcat through hue, the command show as blow:import --connect jdbc:mysql://192.168.122.1:3306/sample --username zhj -...原创 2014-04-14 00:50:48 · 1114 阅读 · 0 评论 -
sqoop2: Architecture
The architecture of Sqoop2 is : The Sqoop server is : References:https://cwiki.apache.org/confluence/display/SQOOP/Home原创 2014-04-12 18:25:55 · 69 阅读 · 0 评论 -
Sqoop2: import and export data By Hue
Import data from mysql to hdfs---------------------------------------- Export data from hdfs to mysql-------------------------------------- ----------------------------...原创 2014-04-02 17:42:43 · 104 阅读 · 0 评论 -
sqoop2 :Install and Basic Usage
Sqoop2 Install1. install server download the tarball form the official website #tar -xzvf sqoop-1.99.3-bin-hadoop200.tar.gz Assume that the server and client will install in the same host:19...原创 2014-03-25 17:16:22 · 66 阅读 · 0 评论 -
sqoop2 与hadoop-2.2.0集成
sqoop是关系型数据库与hadoop之间传递数据的一个工具.下载sqoop 1.99.3按包里的文档安装,出现了以下一些问题:1.启动sqoop.sh server start 时,服务器不能启动,查看sqoop.log发现配置的hadoop目录不是正确的目录或权限不正确.我仔细检查了路径,绝对正确.上网GOOGLE也没有找到解决办法,仔细回想,原来我将sqoop server安装到...原创 2014-03-23 23:10:39 · 112 阅读 · 0 评论 -
sqoop: truncate table prior export data from hdfs
We are using Sqoop to export data from the hive to SQL Server. The new data is always appended to the existing data in SQL Server.Is it possible to truncate the SQL Server table via Sqoop before...原创 2015-01-06 17:18:02 · 541 阅读 · 0 评论 -
Sqoop1:export data to mysql
When I export data to mysql using the following sqoop commands --options-file sqoop.export.opt --export-dir inok/test/friendrecomend2 --table friend_rec --staging-table friend_rec_stage --cle...原创 2014-04-24 16:53:37 · 308 阅读 · 0 评论