Apache Sqoop

最新推荐文章于 2023-05-09 10:19:14 发布

Paulmin

最新推荐文章于 2023-05-09 10:19:14 发布

阅读量584

点赞数

分类专栏： Big Data

本文链接：https://blog.csdn.net/Paulmin/article/details/11881643

版权

Big Data 专栏收录该内容

7 篇文章 0 订阅

订阅专栏

==Hortonworks==

http://docs.hortonworks.com/HDPDocuments/HDP1/HDP-1.3.2/ds_Sqoop/SqoopUserGuide.html - 23-Sep-2013 read complete

==Apache==

http://sqoop.apache.org/docs/1.4.3/index.html

Sqoop is a tool designed to transfer data between Hadoop and relational databases. You can use Sqoop to import data from a relational database management system (RDBMS) such as MySQL or Oracle into the Hadoop Distributed File System (HDFS), transform the data in Hadoop MapReduce, and then export the data back into an RDBMS.

Sqoop automates most of this process, relying on the database to describe the schema for the data to be imported. Sqoop uses MapReduce to import and export the data, which provides parallel operation as well as fault tolerance.

This document describes how to get started using Sqoop to move data between databases and Hadoop and provides reference information for the operation of the Sqoop command-line tool suite.

Before you can use Sqoop, a release of Hadoop must be installed and configured. Sqoop is currently supporting 4 major Hadoop releases - 0.20, 0.23, 1.0 and 2.0.