原文:https://blog.csdn.net/zys_1997/article/details/78358992
大数据学习路线
看到一个博主写的大数据学习路线,看了比较心动,想着自己可以先在Java的道路上继续努力,打好基础。这篇文章也许以后会有用,就转载如下:
【不要错过文末彩蛋】
申明:
本文旨在为普通程序员(Java程序员最佳)提供一个入门级别的大数据技术学习路径,不适用于大数据工程师的进阶学习,也不适用于零编程基础的同学。
前言:
- 一、背景介绍
- 二、大数据介绍
正文:
- 一、大数据相关的工作介绍
- 二、大数据工程师的技能要求
- 三、大数据学习规划
- 四、持续学习资源推荐(书籍,博客,网站)
- 五、项目案例分析(批处理+实时处理)
前言
一、背景介绍
本人目前是一名大数据工程师,项目数据50T,日均数据增长20G左右,个人是从Java后端开发,经过3个月的业余自学成功转型大数据工程师。
二、大数据介绍
大数据本质也是数据,但是又有了新的特征,包括数据来源广、数据格式多样化(结构化数据、非结构化数据、Excel文件、文本文件等)、数据量大(最少也是TB级别的、甚至可能是PB级别)、数据增长速度快等。
针对以上主要的4个特征我们需要考虑以下问题:
-
数据来源广,该如何采集汇总?,对应出现了Sqoop,Cammel,Datax等工具。
-
数据采集之后,该如何存储?,对应出现了GFS,HDFS,TFS等分布式文件存储系统。
-
由于数据增长速度快,数据存储就必须可以水平扩展。
-
数据存储之后,该如何通过运算快速转化成一致的格式,该如何快速运算出自己想要的结果?
对应的MapReduce这样的分布式运算框架解决了这个问题;但是写MapReduce需要Java代码量很大,所以出现了Hive,Pig等将SQL转化成MapReduce的解析引擎;
普通的MapReduce处理数据只能一批一批地处理,时间延迟太长,为了实现每输入一条数据就能得到结果,于是出现了Storm/JStorm这样的低时延的流式计算框架;
但是如果同时需要批处理和流处理,按照如上就得搭两个集群,Hadoop集群(包括HDFS+MapReduce+Yarn)和Storm集群,不易于管理,所以出现了Spark这样的一站式的计算框架,既可以进行批处理,又可以进行流处理(实质上是微批处理)。
-
而后Lambda架构,Kappa架构的出现,又提供了一种业务处理的通用架构。
-
为了提高工作效率,加快运速度,出现了一些辅助工具:
- Ozzie,azkaban:定时任务调度的工具。
- Hue,Zepplin:图形化任务执行管理,结果查看工具。
- Scala语言:编写Spark程序的最佳语言,当然也可以选择用Python。
- Python语言:编写一些脚本时会用到。
- Allluxio,Kylin等:通过对存储的数据进行预处理,加快运算速度的工具。
以上大致就把整个大数据生态里面用到的工具所解决的问题列举了一遍,知道了他们为什么而出现或者说出现是为了解决什么问题,进行学习的时候就有的放矢了。
正文
一、大数据相关工作介绍
大数据方向的工作目前主要分为三个主要方向:
- 大数据工程师
- 数据分析师
- 大数据科学家
- 其他(数据挖掘等)
二、大数据工程师的技能要求
附上大数据工程师技能图:
必须掌握的技能11条
- Java高级(虚拟机、并发)
- Linux 基本操作
- Hadoop(HDFS+MapReduce+Yarn )
- HBase(JavaAPI操作+Phoenix )
- Hive(Hql基本操作和原理理解)
- Kafka
- Storm/JStorm
- Scala
- Python
- Spark (Core+sparksql+Spark streaming )
- 辅助小工具(Sqoop/Flume/Oozie/Hue等)
高阶技能6条
- 机器学习算法以及mahout库加MLlib
- R语言
- Lambda 架构
- Kappa架构
- Kylin
- Alluxio
三、学习路径
假设每天可以抽出3个小时的有效学习时间,加上周末每天保证10个小时的有效学习时间;
3个月会有(21*3+4*2*10)*3=423小时的学习时间。
第一阶段(基础阶段)
1)Linux学习(跟鸟哥学就ok了)—–20小时
- Linux操作系统介绍与安装。
- Linux常用命令。
- Linux常用软件安装。
- Linux网络。
- 防火墙。
- Shell编程等。
官网:https://www.centos.org/download/
中文社区:http://www.linuxidc.com/Linux/2017-09/146919.htm
2)Java 高级学习(《深入理解Java虚拟机》、《Java高并发实战》)—30小时
- 掌握多线程。
- 掌握并发包下的队列。
- 了解JMS。
- 掌握JVM技术。
- 掌握反射和动态代理。
官网:https://www.java.com/zh_CN/
中文社区:http://www.java-cn.com/index.html
3)Zookeeper学习(可以参照这篇博客进行学习:http://www.cnblogs.com/wuxl360/p/5817471.html)
- Zookeeper分布式协调服务介绍。
- Zookeeper集群的安装部署。
- Zookeeper数据结构、命令。
- Zookeeper的原理以及选举机制。
官网:http://zookeeper.apache.org/
中文社区:http://www.aboutyun.com/forum-149-1.html
第二阶段(攻坚阶段)
4)Hadoop (《Hadoop 权威指南》)—80小时
-
HDFS
- HDFS的概念和特性。
- HDFS的shell操作。
- HDFS的工作机制。
- HDFS的Java应用开发。
-
MapReduce
- 运行WordCount示例程序。
- 了解MapReduce内部的运行机制。
- MapReduce程序运行流程解析。
- MapTask并发数的决定机制。
- MapReduce中的combiner组件应用。
- MapReduce中的序列化框架及应用。
- MapReduce中的排序。
- MapReduce中的自定义分区实现。
- MapReduce的shuffle机制。
- MapReduce利用数据压缩进行优化。
- MapReduce程序与YARN之间的关系。
- MapReduce参数优化。
-
MapReduce的Java应用开发
官网:http://hadoop.apache.org/
中文文档:http://hadoop.apache.org/docs/r1.0.4/cn/
中文社区:http://www.aboutyun.com/forum-143-1.html
5)Hive(《Hive开发指南》)–20小时
-
Hive 基本概念
- Hive 应用场景。
- Hive 与hadoop的关系。
- Hive 与传统数据库对比。
- Hive 的数据存储机制。
-
Hive 基本操作
- Hive 中的DDL操作。
- 在Hive 中如何实现高效的JOIN查询。
- Hive 的内置函数应用。
- Hive shell的高级使用方式。
- Hive 常用参数配置。
- Hive 自定义函数和Transform的使用技巧。
- Hive UDF/UDAF开发实例。
-
Hive 执行过程分析及优化策略
官网:https://hive.apache.org/
中文入门文档:http://www.aboutyun.com/thread-11873-1-1.html
中文社区:http://www.aboutyun.com/thread-7598-1-1.html
6)HBase(《HBase权威指南》)—20小时
- hbase简介。
- habse安装。
- hbase数据模型。
- hbase命令。
- hbase开发。
- hbase原理。
官网:http://hbase.apache.org/
中文文档:http://abloz.com/hbase/book.html
中文社区:http://www.aboutyun.com/forum-142-1.html
7)Scala(《快学Scala》)–20小时
- Scala概述。
- Scala编译器安装。
- Scala基础。
- 数组、映射、元组、集合。
- 类、对象、继承、特质。
- 模式匹配和样例类。
- 了解Scala Actor并发编程。
- 理解Akka。
- 理解Scala高阶函数。
- 理解Scala隐式转换。
官网:http://www.scala-lang.org/
初级中文教程:http://www.runoob.com/scala/scala-tutorial.html
8)Spark (《Spark 权威指南》)—60小时
-
Spark core
- Spark概述。
- Spark集群安装。
- 执行第一个Spark案例程序(求PI)。
-
RDD
- RDD概述。
- 创建RDD。
- RDD编程API(Transformation 和 Action Operations)。
- RDD的依赖关系
- RDD的缓存
- DAG(有向无环图)
-
Spark SQL and DataFrame/DataSet
- Spark SQL概述。
- DataFrames。
- DataFrame常用操作。
- 编写Spark SQL查询程序。
-
Spark Streaming
- park Streaming概述。
- 理解DStream。
- DStream相关操作(Transformations 和 Output Operations)。
-
Structured Streaming
-
其他(MLlib and GraphX )
这个部分一般工作中如果不是数据挖掘,机器学习一般用不到,可以等到需要用到的时候再深入学习。
官网:http://spark.apache.org
中文文档(但是版本有点老):https://www.gitbook.com/book/aiyanbo/spark-programming-guide-zh-cn/details
中文社区:http://www.aboutyun.com/forum-146-1.html
9)Python (推荐廖雪峰的博客—30小时
10)自己用虚拟机搭建一个集群,把所有工具都装上,自己开发一个小demo —30小时
可以自己用VMware搭建4台虚拟机,然后安装以上软件,搭建一个小集群(本人亲测,I7,64位,16G内存,完全可以运行起来,以下附上我学习时用虚拟机搭建集群的操作文档)
集群搭建文档1.0版本
1. 集群规划
所有需要用到的软件:
链接:http://pan.baidu.com/s/1jIlAz2Y
密码:kyxl
2. 前期准备
-
2.0 系统安装
-
-
2.1 主机名配置
-
-
2.1.0 vi /etc/sysconfig/network
-
NETWORKING=yes
-
-
2.1.1 vi /etc/sysconfig/network
-
NETWORKING=yes
-
HOSTNAME=ys02
-
-
2.1.2 vi /etc/sysconfig/network
-
NETWORKING=yes
-
-
2.1.3 vi /etc/sysconfig/network
-
NETWORKING=yes
-
HOSTNAME=ys04
-
-
2.2 host文件修改
-
2.2.0 vi /etc/hosts
-
10.1.1.149 ys01
-
10.1.1.148 ys02
-
10.1.1.146 ys03
-
10.1.1.145 ys04
-
2.3 关闭防火墙(centos 7默认使用的是firewall,centos 6 默认是iptables)
-
-
2.3.0 systemctl
stop firewalld.service (停止firewall)
-
-
2.3
.1 systemctl
disable firewalld.service (禁止firewall开机启动)
-
-
2.3
.2 firewall-cmd
--state (查看默认防火墙状态(关闭后显示notrunning,开启后显示running)
-
-
2.4 免密登录(ys01 ->ys02,
03,
04)
-
ssh-keygen -t rsa
-
ssh-copy-
id ys02(随后输入密码)
-
ssh-copy-
id ys03(随后输入密码)
-
ssh-copy-
id ys04(随后输入密码)
-
ssh ys02(测试是否成功)
-
ssh ys03(测试是否成功)
-
ssh ys04(测试是否成功)
-
-
2.5 系统时区与时间同步
-
tzselect(生成日期文件)
-
cp /usr/
share/zoneinfo/Asia/Shanghai /etc/
localtime(将日期文件copy到本地时间中)
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
- 10
- 11
- 12
- 13
- 14
- 15
- 16
- 17
- 18
- 19
- 20
- 21
- 22
- 23
- 24
- 25
- 26
- 27
- 28
- 29
- 30
- 31
- 32
- 33
- 34
- 35
- 36
- 37
- 38
- 39
- 40
- 41
- 42
- 43
- 44
- 45
3. 软件安装
-
3.0 安装目录规划(软件为所有用户公用)
-
-
3.0.0所有软件的安装放到/usr/
local/ys/soft目录下(mkdir /usr/
local/ys/soft)
-
-
3.0.1所有软件安装到/usr/
local/ys/app目录下(mkdir /usr/
local/ys/app)
-
-
3.1 JDK(jdk1.7)安装
-
-
3.1.1 alt+p 后出现sftp窗口,
cd /usr/
local/ys/soft,使用sftp上传tar包到虚机ys01的/usr/
local/ys/soft目录下
-
-
3.1.2解压jdk
-
cd /usr/
local/ys/soft
-
#解压
-
tar -zxvf jdk-7u80-linux-x64.tar.gz -C /usr/
local/ys/app
-
-
3.1.3将java添加到环境变量中
-
vim /etc/profile
-
#在文件最后添加
-
export JAVA_HOME= /usr/
local/ys/app/ jdk-7u80
-
export PATH=
$PATH:
$JAVA_HOME/bin
-
-
3.1.4 刷新配置
-
source /etc/profile
-
-
3.2 Zookeeper安装
-
-
3.2.0解压
-
tar -zxvf zookeeper-3.4.5.tar.gz -C /usr/
local/ys/app(解压)
-
-
3.2.1 重命名
-
mv zookeeper-3.4.5 zookeeper(重命名文件夹zookeeper-3.4.5为zookeeper)
-
-
3.2.2修改环境变量
-
vi /etc/profile(修改文件)
-
添加内容:
-
export ZOOKEEPER_HOME=/usr/
local/ys/app/zookeeper
-
export PATH=
$PATH:
$ZOOKEEPER_HOME/bin
-
-
3.2.3 重新编译文件:
-
source /etc/profile
-
注意:3台zookeeper都需要修改
-
-
3.2.4修改配置文件
-
cd zookeeper/conf
-
cp zoo_sample.cfg zoo.cfg
-
vi zoo.cfg
-
添加内容:
-
dataDir=/usr/
local/ys/app/zookeeper/data
-
dataLogDir=/usr/
local/ys/app/zookeeper/
log
-
server.1=ys01:2888:3888 (主机名, 心跳端口、数据端口)
-
server.2=ys02:2888:3888
-
server.3=ys04:2888:3888
-
-
3.2.5 创建文件夹
-
cd /usr/
local/ys/app/zookeeper/
-
mkdir -m 755 data
-
mkdir -m 755
log
-
-
3.2.6 在data文件夹下新建myid文件,myid的文件内容为:
-
cd data
-
vi myid
-
添加内容:
-
1
-
将集群下发到其他机器上
-
scp -r /usr/
local/ys/app/zookeeper ys02:/usr/
local/ys/app/
-
scp -r /usr/
local/ys/app/zookeeper ys04:/usr/
local/ys/app/
-
-
3.2.7修改其他机器的配置文件
-
到ys02上:修改myid为:2
-
到ys02上:修改myid为:3
-
-
3.2.8启动(每台机器)
-
zkServer.sh start
-
查看集群状态
-
jps(查看进程)
-
zkServer.sh status(查看集群状态,主从信息)
-
-
3.3 Hadoop(HDFS+Yarn)
-
-
3.3.0 alt+p 后出现sftp窗口,使用sftp上传tar包到虚机ys01的/usr/
local/ys/soft目录下
-
-
3.3.1 解压jdk
-
cd /usr/
local/ys/soft
-
#解压
-
tar -zxvf cenos-7-hadoop-2.6.4.tar.gz -C /usr/
local/ys/app
-
-
3.3.2 修改配置文件
-
-
core-site.xml
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
- 10
- 11
- 12
- 13
- 14
- 15
- 16
- 17
- 18
- 19
- 20
- 21
- 22
- 23
- 24
- 25
- 26
- 27
- 28
- 29
- 30
- 31
- 32
- 33
- 34
- 35
- 36
- 37
- 38
- 39
- 40
- 41
- 42
- 43
- 44
- 45
- 46
- 47
- 48
- 49
- 50
- 51
- 52
- 53
- 54
- 55
- 56
- 57
- 58
- 59
- 60
- 61
- 62
- 63
- 64
- 65
- 66
- 67
- 68
- 69
- 70
- 71
- 72
- 73
- 74
- 75
- 76
- 77
- 78
- 79
- 80
- 81
- 82
- 83
- 84
- 85
- 86
- 87
- 88
- 89
- 90
hdfs-site.xml
- 1
- 2
yarn-sifite.xml
- 1
- 2
-
svales
-
-
ys02
-
ys03
-
ys04
-
-
3.3.3集群启动(严格按照下面的步骤)
-
3.3.3.1启动zookeeper集群(分别在ys01、ys02、ys04上启动zk)
-
cd /usr/
local/ys/app/zookeeper-3.4.5/bin/
-
./zkServer.sh start
-
#查看状态:一个leader,两个follower
-
./zkServer.sh status
-
-
3.3.3.2启动journalnode(分别在在mini5、mini6、mini7上执行)
-
cd /usr/
local/ys/app/hadoop-2.6.4
-
sbin/hadoop-daemon.sh start journalnode
-
#运行jps命令检验,ys02、ys03、ys04上多了JournalNode进程
-
-
3.3.3.3格式化HDFS
-
#在ys01上执行命令:
-
hdfs namenode -format
-
#格式化后会在根据core-site.xml中的hadoop.tmp.dir配置生成个文件,这里我配置的是/usr/local/ys/app/hadoop-2.6.4/tmp,然后将/usr/local/ys/app/hadoop-2.6.4/tmp拷贝到ys02的/usr/local/ys/app/hadoop-2.6.4/下。
-
scp -r tmp/ ys02:/usr/
local/ys /app/hadoop-2.6.4/
-
##也可以这样,建议hdfs namenode -bootstrapStandby
-
-
3.3.3.4格式化ZKFC(在ys01上执行一次即可)
-
hdfs zkfc -formatZK
-
-
3.3.3.5启动HDFS(在ys01上执行)
-
sbin/start-dfs.sh
-
-
3.3.3.6启动YARN
-
sbin/start-yarn.sh
-
-
3.3MySQL-5.6安装
-
略过
-
-
3.4 Hive
-
-
3.4.1 alt+p 后出现sftp窗口,
cd /usr/
local/ys/soft,使用sftp上传tar包到虚机ys01的/usr/
local/ys/soft目录下
-
-
3.4.2解压
-
cd /usr/
local/ys/soft
-
tar -zxvf hive-0.9.0.tar.gz -C /usr/
local/ys/app
-
-
3.4.3 .配置hive
-
-
3.4.3.1配置HIVE_HOME环境变量 vi conf/hive-env.sh 配置其中的
$hadoop_home
-
-
3.4.3.2配置元数据库信息 vi hive-site.xml
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
- 10
- 11
- 12
- 13
- 14
- 15
- 16
- 17
- 18
- 19
- 20
- 21
- 22
- 23
- 24
- 25
- 26
- 27
- 28
- 29
- 30
- 31
- 32
- 33
- 34
- 35
- 36
- 37
- 38
- 39
- 40
- 41
- 42
- 43
- 44
- 45
- 46
- 47
- 48
- 49
- 50
- 51
添加如下内容:
-
3.4.4 安装hive和mysq完成后,将mysql的连接jar包拷贝到
$HIVE_HOME/lib目录下
-
如果出现没有权限的问题,在mysql授权(在安装mysql的机器上执行)
-
mysql -uroot -p
-
#(执行下面的语句 *.*:所有库下的所有表 %:任何IP地址或主机都可以连接)
-
GRANT ALL PRIVILEGES ON *.* TO
'root'@
'%' IDENTIFIED BY
'root' WITH GRANT OPTION;
-
FLUSH PRIVILEGES;
-
-
3.4.5 Jline包版本不一致的问题,需要拷贝hive的lib目录中jline.2.12.jar的jar包替换掉hadoop中的 /usr/
local/ys/app/hadoop-2.6.4/share/hadoop/yarn/lib/jline-0.9.94.jar
-
-
3.4.6启动hive
-
bin/hive
-
-
3.5 Kafka
-
3.5.1 下载安装包
-
http://kafka.apache.org/downloads.html
-
在linux中使用wget命令下载安装包
-
wget http://mirrors.hust.edu.cn/apache/kafka/0.8.2.2/kafka_2.11-0.8.2.2.tgz
-
-
3.5.2 解压安装包
-
tar -zxvf /usr/
local/ys/soft/kafka_2.11-0.8.2.2.tgz -C /usr/
local/ys/app/
-
cd /usr/
local/ys/app/
-
ln -s kafka_2.11-0.8.2.2 kafka
-
-
3.5.3 修改配置文件
-
cp
-
/usr/
local/ys/app/kafka/config/server.properties
-
/usr/
local/ys/app/kafka/config/server.properties.bak
-
vi /usr/
local/ys/kafka/config/server.properties
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
- 10
- 11
- 12
- 13
- 14
- 15
- 16
- 17
- 18
- 19
- 20
- 21
- 22
- 23
- 24
- 25
- 26
- 27
- 28
- 29
输入以下内容:
-
3.5.4 分发安装包
-
scp -r /usr/
local/ys/app/kafka_2.11-0.8.2.2 ys02: /usr/
local/ys/app/
-
scp -r /usr/
local/ys/app/kafka_2.11-0.8.2.2 ys03: /usr/
local/ys/app/
-
scp -r /usr/
local/ys/app/kafka_2.11-0.8.2.2 ys04: /usr/
local/ys/app/
-
然后分别在各机器上创建软连
-
cd /usr/
local/ys/app/
-
ln -s kafka_2.11-0.8.2.2 kafka
-
-
3.5.5 再次修改配置文件(重要)
-
依次修改各服务器上配置文件的的broker.id,分别是0,1,2不得重复。
-
-
3.5.6 启动集群
-
依次在各节点上启动kafka
-
bin/kafka-server-start.sh config/server.properties
-
-
3.6 Spark
-
-
3.6.1 alt+p 后出现sftp窗口,
cd /usr/
local/ys/soft,使用sftp上传tar包到虚机ys01的/usr/
local/ys/soft目录下
-
-
3.6.2 解压安装包
-
tar -zxvf /usr/
local/ys/soft/ spark-1.6.1-bin-hadoop2.6.tgz -C /usr/
local/ys/app/
-
-
3.6.3 修改Spark配置文件(两个配置文件spark-env.sh和slaves)
-
cd /usr/
local/ys/soft/spark-1.6.1-bin-hadoop2.6
-
进入conf目录并重命名并修改spark-env.sh.template文件
-
cd conf/
-
mv spark-env.sh.template spark-env.sh
-
vi spark-env.sh
-
在该配置文件中添加如下配置
-
export JAVA_HOME=/usr/java/jdk1.7.0_45
-
export SPARK_MASTER_PORT=7077
-
export SPARK_DAEMON_JAVA_OPTS=
"-Dspark.deploy.recoveryMode=ZOOKEEPER -Dspark.deploy.zookeeper.url=ys01,ys02,ys04 -Dspark.deploy.zookeeper.dir=/spark"
-
保存退出
-
重命名并修改slaves.template文件
-
mv slaves.template slaves
-
vi slaves
-
在该文件中添加子节点所在的位置(Worker节点)
-
Ys02
-
Ys03
-
Ys04
-
保存退出
-
-
3.6.4 将配置好的Spark拷贝到其他节点上
-
scp -r spark-1.6.1-in-hadoop2.6/ ys02:/usr/
local/ys/app
-
scp -r spark-1.6.1-bin-hadoop2.6/ ys03:/usr/
local/ys/app
-
scp -r spark-1.6.1-bin-hadoop2.6/ ys04:/usr/
local/ys/app
-
-
3.6.5 集群启动
-
在ys01上执行sbin/start-all.sh脚本
-
然后在ys02上执行sbin/start-master.sh启动第二个Master
-
-
3.7 Azkaban
-
-
3.7.1 azkaban web服务器安装
-
解压azkaban-web-server-2.5.0.tar.gz
-
命令: tar –zxvf /usr/
local/ys/soft/azkaban-web-server-2.5.0.tar.gz -C /usr/
local/ys/app/azkaban
-
将解压后的azkaban-web-server-2.5.0 移动到 azkaban目录中,并重新命名 webserver
-
命令: mv azkaban-web-server-2.5.0 ../azkaban
-
cd ../azkaban
-
mv azkaban-web-server-2.5.0 webserver
-
-
3.7.2 azkaban 执行服器安装
-
解压azkaban-executor-server-2.5.0.tar.gz
-
命令:tar –zxvf /usr/
local/ys/soft/azkaban-executor-server-2.5.0.tar.gz -C /usr/
local/ys/app/azkaban
-
将解压后的azkaban-executor-server-2.5.0 移动到 azkaban目录中,并重新命名 executor
-
命令:mv azkaban-executor-server-2.5.0 ../azkaban
-
cd ../azkaban
-
mv azkaban-executor-server-2.5.0 executor
-
-
3.7.3 azkaban脚本导入
-
解压: azkaban-sql-script-2.5.0.tar.gz
-
命令:tar –zxvf azkaban-sql-script-2.5.0.tar.gz
-
将解压后的mysql 脚本,导入到mysql中:
-
进入mysql
-
mysql> create database azkaban;
-
mysql> use azkaban;
-
Database changed
-
mysql>
source /usr/
local/ys/soft/azkaban-2.5.0/create-all-sql-2.5.0.sql;
-
-
3.7.4 创建SSL配置
-
参考地址: http://docs.codehaus.org/display/JETTY/How+to+configure+SSL
-
命令: keytool -keystore keystore -
alias jetty -genkey -keyalg RSA
-
运行此命令后,会提示输入当前生成 keystor的密码及相应信息,输入的密码请劳记,信息如下(此处我输入的密码为:123456)
-
输入keystore密码:
-
再次输入新密码:
-
您的名字与姓氏是什么?
-
[Unknown]:
-
您的组织单位名称是什么?
-
[Unknown]:
-
您的组织名称是什么?
-
[Unknown]:
-
您所在的城市或区域名称是什么?
-
[Unknown]:
-
您所在的州或省份名称是什么?
-
[Unknown]:
-
该单位的两字母国家代码是什么
-
[Unknown]: CN
-
CN=Unknown, OU=Unknown, O=Unknown, L=Unknown, ST=Unknown, C=CN 正确吗?
-
[否]: y
-
输入<jetty>的主密码(如果和 keystore 密码相同,按回车):
-
再次输入新密码
-
完成上述工作后,将在当前目录生成 keystore 证书文件,将keystore 考贝到 azkaban web服务器根目录中.如:cp keystore azkaban/webserver
-
-
3.7.5 配置文件
-
注:先配置好服务器节点上的时区
-
先生成时区配置文件Asia/Shanghai,用交互式命令 tzselect 即可
-
拷贝该时区文件,覆盖系统本地时区配置
-
cp /usr/share/zoneinfo/Asia/Shanghai /etc/localtime
-
-
3.7.6 azkaban web服务器配置
-
进入azkaban web服务器安装目录 conf目录
-
修改azkaban.properties文件
-
命令vi azkaban.properties
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
- 10
- 11
- 12
- 13
- 14
- 15
- 16
- 17
- 18
- 19
- 20
- 21
- 22
- 23
- 24
- 25
- 26
- 27
- 28
- 29
- 30
- 31
- 32
- 33
- 34
- 35
- 36
- 37
- 38
- 39
- 40
- 41
- 42
- 43
- 44
- 45
- 46
- 47
- 48
- 49
- 50
- 51
- 52
- 53
- 54
- 55
- 56
- 57
- 58
- 59
- 60
- 61
- 62
- 63
- 64
- 65
- 66
- 67
- 68
- 69
- 70
- 71
- 72
- 73
- 74
- 75
- 76
- 77
- 78
- 79
- 80
- 81
- 82
- 83
- 84
- 85
- 86
- 87
- 88
- 89
- 90
- 91
- 92
- 93
- 94
- 95
- 96
- 97
- 98
- 99
- 100
- 101
- 102
- 103
- 104
- 105
- 106
- 107
- 108
- 109
- 110
- 111
- 112
- 113
- 114
内容说明如下:
-
*Azkaban Personalization Settings
-
azkaban
.name=Test
#服务器UI名称,用于服务器上方显示的名字
-
azkaban
.label=My Local Azkaban
#描述
-
azkaban
.color=
#FF3601 #UI颜色
-
azkaban
.default
.servlet
.path=/index
#
-
web
.resource
.dir=web/
#默认根web目录
-
default
.timezone
.id=Asia/Shanghai
#默认时区,已改为亚洲/上海 默认为美国
-
-
*Azkaban UserManager
class
-
user
.manager
.class=azkaban
.user
.XmlUserManager
#用户权限管理默认类
-
user
.manager
.xml
.file=conf/azkaban-users
.xml
#用户配置,具体配置参加下文
-
-
*Loader
for projects
-
executor
.global
.properties=conf/
global
.properties
# global配置文件所在位置
-
azkaban
.project
.dir=projects
#
-
-
database
.type=mysql
#数据库类型
-
mysql
.port=
3306
#端口号
-
mysql
.host=localhost
#数据库连接IP
-
mysql
.database=azkaban
#数据库实例名
-
mysql
.user=root
#数据库用户名
-
mysql
.password=Root123456
#数据库密码
-
mysql
.numconnections=
100
#最大连接数
-
-
* Velocity dev mode
-
velocity
.dev
.mode=
false
-
* Jetty服务器属性.
-
jetty
.maxThreads=
25
#最大线程数
-
jetty
.ssl
.port=
8443
#Jetty SSL端口
-
jetty
.port=
8081
#Jetty端口
-
jetty
.keystore=keystore
#SSL文件名
-
jetty
.password=
123456
#SSL文件密码
-
jetty
.keypassword=
123456
#Jetty主密码 与 keystore文件相同
-
jetty
.truststore=keystore
#SSL文件名
-
jetty
.trustpassword=
123456
# SSL文件密码
-
-
* 执行服务器属性
-
executor
.port=
12321
#执行服务器端
-
-
*邮件设置
-
mail
.sender=xxxxxxxx
@163
.com
#发送邮箱
-
mail
.host=smtp
.163
.com
#发送邮箱smtp地址
-
mail
.user=xxxxxxxx
#发送邮件时显示的名称
-
mail
.password=**********
#邮箱密码
-
job
.failure
.email=xxxxxxxx
@163
.com
#任务失败时发送邮件的地址
-
job
.success
.email=xxxxxxxx
@163
.com
#任务成功时发送邮件的地址
-
lockdown
.create
.projects=
false
#
-
cache
.directory=cache
#缓存目录
-
-
3.7
.7azkaban 执行服务器executor配置
-
进入执行服务器安装目录conf,修改azkaban
.properties
-
vi azkaban
.properties
-
*Azkaban
-
default
.timezone
.id=Asia/Shanghai
#时区
-
-
* Azkaban JobTypes 插件配置
-
azkaban
.jobtype
.plugin
.dir=plugins/jobtypes
#jobtype 插件所在位置
-
-
*Loader
for projects
-
executor
.global
.properties=conf/
global
.properties
-
azkaban
.project
.dir=projects
-
-
*数据库设置
-
database
.type=mysql
#数据库类型(目前只支持mysql)
-
mysql
.port=
3306
#数据库端口号
-
mysql
.host=
192.168
.20
.200
#数据库IP地址
-
mysql
.database=azkaban
#数据库实例名
-
mysql
.user=root
#数据库用户名
-
mysql
.password=Root23456
#数据库密码
-
mysql
.numconnections=
100
#最大连接数
-
-
*执行服务器配置
-
executor
.maxThreads=
50
#最大线程数
-
executor
.port=
12321
#端口号(如修改,请与web服务中一致)
-
executor
.flow
.threads=
30
#线程数
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
- 10
- 11
- 12
- 13
- 14
- 15
- 16
- 17
- 18
- 19
- 20
- 21
- 22
- 23
- 24
- 25
- 26
- 27
- 28
- 29
- 30
- 31
- 32
- 33
- 34
- 35
- 36
- 37
- 38
- 39
- 40
- 41
- 42
- 43
- 44
- 45
- 46
- 47
- 48
- 49
- 50
- 51
- 52
- 53
- 54
- 55
- 56
- 57
- 58
- 59
- 60
- 61
- 62
- 63
- 64
- 65
- 66
- 67
- 68
- 69
- 70
- 71
- 72
- 73
- 74
- 75
-
3
.7
.8用户配置
-
进入
azkaban
web服务器
conf目录,修改
azkaban-users
.xml
-
vi
azkaban-users
.xml 增加 管理员用户
- 1
- 2
- 3
- 4
-
3.7.
9 web服务器启动
-
在azkaban web服务器目录下执行启动命令
-
bin/azkaban-web-start.sh
-
注:在web服务器根目录运行
-
或者启动到后台
-
nohup bin/azkaban-web-start.sh
1>/tmp/azstd.
out
2>/tmp/azerr.
out &
-
-
3.7.
10执行服务器启动
-
-
在执行服务器目录下执行启动命令
-
bin/azkaban-executor-start.sh
-
注:只能要执行服务器根目录运行
-
-
启动完成后,在浏览器(建议使用谷歌浏览器)中输入https:
//服务器IP地址:8443 ,即可访问azkaban服务了.在登录中输入刚才新的户用名及密码,点击 login
-
-
3.8 Zeppelin
-
参照如下文件:
-
http:
//blog.csdn.net/chengxuyuanyonghu/article/details/54915817
-
http:
//blog.csdn.net/chengxuyuanyonghu/article/details/54915962
-
-
3.9 HBase
-
3.9.
1解压
-
tar –zxvf /usr/
local/ys/soft/hbase-
0.99.
2-bin.tar.gz -C /usr/
local/ys/app
-
-
3.9.
2重命名
-
cd /usr/
local/ys/app
-
mv hbase-
0.99.
2 hbase
-
-
3.9.
3修改配置文件
-
每个文件的解释如下:
-
hbase-env.sh
-
export JAVA_HOME=/usr/
local/ys/app/jdk1.
7.0_80
//jdk安装目录
-
export HBASE_CLASSPATH=/usr/
local/ys/app/hadoop-
2.6.
4/etc/hadoop
//hadoop配置文件的位置
-
export HBASE_MANAGES_ZK=false #如果使用独立安装的zookeeper这个地方就是false(此处使用自己的zookeeper)
-
-
hbase-site.xml
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
- 10
- 11
- 12
- 13
- 14
- 15
- 16
- 17
- 18
- 19
- 20
- 21
- 22
- 23
- 24
- 25
- 26
- 27
- 28
- 29
- 30
- 31
- 32
- 33
- 34
- 35
- 36
- 37
-
Regionservers
//是从机器的域名
-
Ys02
-
ys03
-
ys04
-
-
注:此处HBase配置是针对HA模式的hdfs
-
-
3.9.
4将Hadoop的配置文件hdfs-site.xml和core-site.xml拷贝到HBase配置文件中
-
cp /usr/
local/ys/app/Hadoop-
2.6.
4/etc/hadoop/hdfs-site.xml /usr/
local/ys/app/hbase/conf
-
cp /usr/
local/ys/app/hadoop-
2.6.
4/etc/hadoop/core-site.xml /usr/
local/ys/app/hbase/conf
-
-
3.9.
5发放到其他机器
-
scp –r /usr/
local/ys/app/hbase ys02: /usr/
local/ys/app
-
scp –r /usr/
local/ys/app/hbase ys03: /usr/
local/ys/app
-
scp –r /usr/
local/ys/app/hbase ys04: /usr/
local/ys/app
-
-
3.9.
6启动
-
cd /usr/
local/ys/app/hbase/bin
-
./ start-hbase.sh
-
-
3.9.
7查看
-
进程:jps
-
进入hbase的shell:hbase shell
-
退出hbase的shell:quit
-
页面:http:
//master:60010/
-
-
3.10KAfkaOffsetMonitor(Kafka集群的监控程序,本质就是一个jar包)
-
-
3.10.
1上传jar包
-
略
-
-
3.10.
2 运行jar包
-
nohup java -cp KafkaOffsetMonitor-assembly-
0.2.
1.jar com.quantifind.kafka.offsetapp.OffsetGetterWeb --zk ys01,ys02,ys04 --refresh
5.minutes --retain
1.day --port
8089 $
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
- 10
- 11
- 12
- 13
- 14
- 15
- 16
- 17
- 18
- 19
- 20
- 21
- 22
- 23
- 24
- 25
- 26
- 27
- 28
- 29
- 30
- 31
- 32
- 33
- 34
4. 集群调优
-
4.1 辅助工具尽量不安装到数据或者运算节点,避免占用过多计算或内存资源。
-
-
4.2 dataNode和spark的slave节点尽量在一起;这样运算的时候就可以避免通过网络拉取数据,加快运算速度。
-
-
4.3 Hadoop集群机架感知配置,配置之后可以使得数据在同机架的不同机器
2份,然后其他机架机器
1份,可是两台机器四台虚机没有必要配感知个人感觉。
-
-
4.4 配置参数调优
-
可以参考http:
//blog.csdn.net/chndata/article/details/46003399
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
第三阶段(辅助工具工学习阶段)
11)Sqoop(CSDN,51CTO ,以及官网)—20小时
- 数据导出概念介绍
- Sqoop基础知识
- Sqoop原理及配置说明
- Sqoop数据导入实战
- Sqoop数据导出实战、
- Sqoop批量作业操作
推荐学习博客:http://student-lp.iteye.com/blog/2157983
官网:http://sqoop.apache.org/
12)Flume(CSDN,51CTO ,以及官网)—20小时
- FLUME日志采集框架介绍。
- FLUME工作机制。
- FLUME核心组件。
- FLUME参数配置说明。
- FLUME采集nginx日志案例(案例一定要实践一下)
推荐学习博客:http://www.aboutyun.com/thread-8917-1-1.html
官网:http://flume.apache.org
13)Oozie(CSDN,51CTO ,以及官网)–20小时
- 任务调度系统概念介绍。
- 常用任务调度工具比较。
- Oozie介绍。
- Oozie核心概念。
- Oozie的配置说明。
- Oozie实现mapreduce/hive等任务调度实战案例。
推荐学习博客:http://www.infoq.com/cn/articles/introductionOozie
官网:http://oozie.apache.org/
14)Hue(CSDN,51CTO ,以及官网)–20小时
推荐学习博客:http://ju.outofmemory.cn/entry/105162
官网:http://gethue.com/
第四阶段(不断学习阶段)
每天都会有新的东西出现,需要关注最新技术动态,不断学习。任何一般技术都是先学习理论,然后在实践中不断完善理论的过程。
备注
1)如果你觉得自己看书效率太慢,你可以网上搜集一些课程,跟着课程走也OK 。如果看书效率不高就很网课,相反的话就自己看书。
2)企业目前更倾向于使用Spark进行微批处理,Storm只有在对时效性要求极高的情况下,才会使用,所以可以做了解。重点学习Spark Streaming。
3)快速学习的能力、解决问题的能力、沟通能力**真的很重要。
4)要善于使用StackOverFlow和Google(遇到解决不了的问题,先Google,如果Google找不到解决方能就去StackOverFlow提问,一般印度三哥都会在2小时内回答你的问题)。
5)视频课程推荐:
可以去万能的淘宝购买一些视频课程,你输入“大数据视频课程”,会出现很多,多购买几份(100块以内可以搞定),然后选择一个适合自己的。个人认为小象学院的董西成和陈超的课程含金量会比较高。
四、持续学习资源推荐
- Apache 官网(http://apache.org/)
- Stackoverflow(https://stackoverflow.com/)
- Github(https://github.com/)
- Cloudra官网(https://www.cloudera.com/)
- Databrick官网(https://databricks.com/)
- About 云 :http://www.aboutyun.com/
- CSDN,51CTO (http://www.csdn.net/,http://www.51cto.com/)
- 至于书籍当当一搜会有很多,其实内容都差不多。
五、项目案例分析
1)点击流日志项目分析(此处借鉴CSDN博主的文章,由于没有授权,所以就没有贴过来,下面附上链接)—-批处理
http://blog.csdn.net/u014033218/article/details/76847263
2)Spark Streaming在京东的项目实战(京东的实战案例值得好好研究一下,由于没有授权,所以就没有贴过来,下面附上链接)—实时处理
http://download.csdn.net/download/csdndataid_123/8079233
最后但却很重要一点:每天都会有新的技术出现,要多关注技术动向,持续学习。
以上内容不保证一年以后仍适用。
【GitChat达人课】
- 前端恶棍 · 大漠穷秋 :《Angular 初学者快速上手教程 》
- Python 中文社区联合创始人 · Zoom.Quiet :《GitQ: GitHub 入味儿 》
- 前端颜值担当 · 余博伦:《如何从零学习 React 技术栈 》
- GA 最早期使用者 · GordonChoi:《GA 电商数据分析实践课》
- 技术总监及合伙人 · 杨彪:《Gradle 从入门到实战》
- 混元霹雳手 · 江湖前端:《Vue 组件通信全揭秘》
- 知名互联网公司安卓工程师 · 张拭心:《安卓工程师跳槽面试全指南》
前言:
一、背景介绍
二、大数据介绍
正文:
一、大数据相关的工作介绍
…
来自: weixin_41122339的博客
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/sinat_38648491/article/details/79032396,BlogCommendFromBaidu_1,index_1"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/sinat_38648491/article/details/79032396,BlogCommendFromBaidu_1,index_1"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/sinat_38648491/article/details/79032396" target="_blank" title="2018年最新Hadoop大数据开发学习路线图">
<h4 class="text-truncate oneline" style="width: 859px;">
2018年最新Hadoop<em>大数据</em>开发<em>学习</em><em>路线</em>图 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/2/7/B/3_sinat_38648491.jpg" alt="sinat_38648491" class="avatar-pic">
<span class="namebox">
<span class="name">sinat_38648491</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">01-11</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
2.7万</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/sinat_38648491/article/details/79032396" target="_blank" title="2018年最新Hadoop大数据开发学习路线图">
<span class="desc oneline">Hadoop发展到今天家族产品已经非常丰富,能够满足不同场景的大数据处理需求。作为目前主流的大数据处理技术,市场上很多公司的大数据业务都是基于Hadoop开展,而且对很多场景已经具有非常成熟的解决方案...</span>
</a>
<span class="blog_title_box oneline"><a target="_blank" href="https://blog.csdn.net/sinat_38648491">来自: <span class="blog_title"> sinat_38648491的博客</span></a></span>
</p>
</div>
</div>
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/qq_38872310/article/details/79758426,BlogCommendFromBaidu_2,index_2"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/qq_38872310/article/details/79758426,BlogCommendFromBaidu_2,index_2"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_38872310/article/details/79758426" target="_blank" title="大数据学习路线图">
<h4 class="text-truncate oneline" style="width: 861px;">
<em>大数据</em><em>学习</em><em>路线</em>图 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/9/2/0/3_qq_38872310.jpg" alt="qq_38872310" class="avatar-pic">
<span class="namebox">
<span class="name">qq_38872310</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">03-30</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
3329</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_38872310/article/details/79758426" target="_blank" title="大数据学习路线图">
<span class="desc oneline">一、入门准备
1、linux操作基础
-
Linux的介绍,Linux的安装:VMware Workstation虚拟软件安装过程、CentOS虚拟机安装过程
-
Linux的常用命令:常用命令…
来自: qq_38872310的博客
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/yuexianchang/article/details/52468291,BlogCommendFromBaidu_3,index_3"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/yuexianchang/article/details/52468291,BlogCommendFromBaidu_3,index_3"}" data-flg="true"> <div class="content" style="width: 952px;"> <a href="https://blog.csdn.net/yuexianchang/article/details/52468291" target="_blank" title="大数据经典学习路线(及供参考)资料群:905572354(新群)"> <h4 class="text-truncate oneline" style="width: 852px;"> <em>大数据</em>经典<em>学习</em><em>路线</em>(及供参考)资料群:905572354(新群) </h4> <div class="info-box d-flex align-content-center"> <!-- <p class="avatar"> <img src="https://avatar.csdn.net/7/0/7/3_yuexianchang.jpg" alt="yuexianchang" class="avatar-pic"> <span class="namebox"> <span class="name">yuexianchang</span> <span class="triangle"></span> </span> </p> --> <p class="date-and-readNum"> <span class="date hover-show">09-08</span> <span class="read-num hover-hide"> <svg class="icon csdnc-yuedushu" aria-hidden="true"> <use xlink:href="#csdnc-m-passwords-visible"></use> </svg> 11.4万</span> </p> </div> </a> <p class="content" style="width: 952px;"> <a href="https://blog.csdn.net/yuexianchang/article/details/52468291" target="_blank" title="大数据经典学习路线(及供参考)资料群:905572354(新群)"> <span class="desc oneline">1.Linux基础和分布式集群技术
学完此阶段可掌握的核心能力:
熟练使用Linux,熟练安装Linux上的软件,了解熟悉负载均衡、高可靠等集群相关概念,搭建互联网高并发、高可靠的服务架构;…
来自: 啊哈程序
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/acmjk/article/details/78597179,BlogCommendFromBaidu_4,index_4"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/acmjk/article/details/78597179,BlogCommendFromBaidu_4,index_4"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/acmjk/article/details/78597179" target="_blank" title="大数据开发学习路线图">
<h4 class="text-truncate oneline" style="width: 869px;">
<em>大数据</em>开发<em>学习</em><em>路线</em>图 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/8/3/E/3_acmjk.jpg" alt="acmjk" class="avatar-pic">
<span class="namebox">
<span class="name">acmjk</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">11-21</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
881</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/acmjk/article/details/78597179" target="_blank" title="大数据开发学习路线图">
<span class="desc oneline">入门知识推荐书籍
1、舍恩伯格的《大数据时代》;
2、巴拉巴西的《爆发》;
3、涂子沛的《大数据》;
4、吴军《智能时代》;
5、《大数据架构商业之路:从业务需求到技术方案》工具技能1、ha…
来自: http://bclsj.cn/
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/hemin1003/article/details/73603836,BlogCommendFromBaidu_5,index_5"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/hemin1003/article/details/73603836,BlogCommendFromBaidu_5,index_5"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/hemin1003/article/details/73603836" target="_blank" title="大数据技术学习路线">
<h4 class="text-truncate oneline" style="width: 859px;">
<em>大数据</em>技术<em>学习</em><em>路线</em> </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/7/4/3/3_hemin1003.jpg" alt="hemin1003" class="avatar-pic">
<span class="namebox">
<span class="name">hemin1003</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">06-22</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
2.2万</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/hemin1003/article/details/73603836" target="_blank" title="大数据技术学习路线">
<span class="desc oneline">如果你看完有信心能坚持学习的话,那就当下开始行动吧!
一、大数据技术基础
1、linux操作基础
linux系统简介与安装
linux常用命令–文件操作
linux常用命令–用户管理与权限…
来自: Think Different
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/itcast_cn/article/details/80923559,BlogCommendFromBaidu_6,index_6"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/itcast_cn/article/details/80923559,BlogCommendFromBaidu_6,index_6"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/itcast_cn/article/details/80923559" target="_blank" title="大数据教程,大数据学习线路图">
<h4 class="text-truncate oneline" style="width: 861px;">
<em>大数据</em>教程,<em>大数据</em><em>学习</em>线路图 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/7/7/F/3_itcast_cn.jpg" alt="itcast_cn" class="avatar-pic">
<span class="namebox">
<span class="name">itcast_cn</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">07-05</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
1040</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/itcast_cn/article/details/80923559" target="_blank" title="大数据教程,大数据学习线路图">
<span class="desc oneline">前言先引用一下马云大大的话:
很多人还没搞清楚什么是PC互联网,移动互联网来了,我们还没搞清楚移动互联的时候,大数据时代又来了。 马云
深度解析大数据
“大数据”是近年来IT行业的热词,并广泛的…
来自: 传智播客官方博客
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/topzyk/article/details/79774198,BlogCommendFromBaidu_7,index_7"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/topzyk/article/details/79774198,BlogCommendFromBaidu_7,index_7"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/topzyk/article/details/79774198" target="_blank" title="2018大数据学习路线图">
<h4 class="text-truncate oneline" style="width: 869px;">
2018<em>大数据</em><em>学习</em><em>路线</em>图 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/2/B/D/3_topzyk.jpg" alt="topzyk" class="avatar-pic">
<span class="namebox">
<span class="name">topzyk</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">03-31</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
976</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/topzyk/article/details/79774198" target="_blank" title="2018大数据学习路线图">
<span class="desc oneline">纯零基础的学习者可以先按照如下顺序学习大数据,真正进入企业以后,编程语言不是最重要的,之所以要懂编程语言在于进入企业的门槛再不断的提高。1.javase+mysql+jdbc2.linux3.Hado...</span>
</a>
<span class="blog_title_box oneline"><a target="_blank" href="https://blog.csdn.net/topzyk">来自: <span class="blog_title"> topzyk的博客</span></a></span>
</p>
</div>
</div>
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/qq_40160605/article/details/84667066,BlogCommendESEnWordWeight_8,index_8"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/qq_40160605/article/details/84667066,BlogCommendESEnWordWeight_8,index_8"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_40160605/article/details/84667066" target="_blank" title="关于A类地址,B类地址,C类地址的划分和详细理解">
<h4 class="text-truncate oneline" style="width: 861px;">
关于A类地址,B类地址,C类地址的划分和详细理解 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/5/B/0/3_qq_40160605.jpg" alt="qq_40160605" class="avatar-pic">
<span class="namebox">
<span class="name">qq_40160605</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">11-30</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
2450</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_40160605/article/details/84667066" target="_blank" title="关于A类地址,B类地址,C类地址的划分和详细理解">
<span class="desc oneline">关于A类地址,B类地址,C类地址的划分和详细理解
<div class="recommend-item-box type_hot_word">
<div class="content clearfix oneline" style="width: 952px;">
<h5 class="float-left">文章热词</h5>
<div class="word float-left">
<span>
<a href="https://edu.csdn.net/combos/o317_s328_l0_t " target="_blank">
大数据学习 </a></span>
<span>
<a href="https://edu.csdn.net/courses/o377_s392_k " target="_blank">
物联网技术学习路线 </a></span>
<span>
<a href="https://edu.csdn.net/courses/o230_s333_k " target="_blank">
Android学习路线 </a></span>
<span>
<a href="https://edu.csdn.net/courses/o280_s281_k " target="_blank">
C/C++学习路线 </a></span>
<span>
<a href="https://edu.csdn.net/courses/o317_k " target="_blank">
云计算/大数据学习 </a></span>
</div>
</div>
</div>
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/qq_31456593/article/details/59182686,BlogCommendFromBaidu_9,index_9"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/qq_31456593/article/details/59182686,BlogCommendFromBaidu_9,index_9"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_31456593/article/details/59182686" target="_blank" title="大数据学习心得">
<h4 class="text-truncate oneline" style="width: 859px;">
<em>大数据</em><em>学习</em>心得 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/5/B/5/3_qq_31456593.jpg" alt="qq_31456593" class="avatar-pic">
<span class="namebox">
<span class="name">qq_31456593</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">03-01</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
1.4万</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_31456593/article/details/59182686" target="_blank" title="大数据学习心得">
<span class="desc oneline">大数据学习心得一、 概述1大数据简介
1.1起源
“大数据“,近几年来最火的词之一。虽然大数据这个词的正式产生也就10年左右,但对大数据分析却早就有之。早在互联网初期,就有很多公司通过计算机技术…
来自: 知行_那片天
<div class="recommend-item-box blog-expert-recommend-box" style="display: block;">
<div class="d-flex">
<div class="blog-expert-recommend">
<div class="blog-expert">
<div class="blog-expert-flexbox" data-track-view="{"mod":"popu_709","con":"https://blog.csdn.net/zys_1997/article/details/78358992"}"><div class="blog-expert-item"><div class="blog-expert-info-box"><div class="blog-expert-img-box" data-track-click="{"mod":"popu_709","con":"https://blog.csdn.net/zys_1997/article/details/78358992"}"><a href="https://blog.csdn.net/qq_41800874" target="_blank"><img src="https://avatar.csdn.net/F/8/8/3_qq_41800874.jpg" alt="web前端开发交流" title="web前端开发交流"></a><span data-track-click="{"mod":"popu_710","con":"https://blog.csdn.net/zys_1997/article/details/78358992"}"><span class="blog-expert-button-follow btn-red-follow" data-name="qq_41800874" data-nick="web前端开发交流">关注</span></span></div><div class="info"><span data-track-click="{"mod":"popu_709","con":"https://blog.csdn.net/zys_1997/article/details/78358992"}"><a href="https://blog.csdn.net/qq_41800874" target="_blank"><h5 class="oneline" title="web前端开发交流">web前端开发交流</h5></a></span> <p></p><p class="article-num" title="100篇文章"> 100篇文章</p><p class="article-num" title="排名:56599"> 排名:56599</p><p></p></div></div></div><div class="blog-expert-item"><div class="blog-expert-info-box"><div class="blog-expert-img-box" data-track-click="{"mod":"popu_709","con":"https://blog.csdn.net/zys_1997/article/details/78358992"}"><a href="https://blog.csdn.net/m0_37803704" target="_blank"><img src="https://avatar.csdn.net/5/4/5/3_m0_37803704.jpg" alt="假的鱼" title="假的鱼"></a><span data-track-click="{"mod":"popu_710","con":"https://blog.csdn.net/zys_1997/article/details/78358992"}"><span class="blog-expert-button-follow btn-red-follow" data-name="m0_37803704" data-nick="假的鱼">关注</span></span></div><div class="info"><span data-track-click="{"mod":"popu_709","con":"https://blog.csdn.net/zys_1997/article/details/78358992"}"><a href="https://blog.csdn.net/m0_37803704" target="_blank"><h5 class="oneline" title="假的鱼">假的鱼</h5></a></span> <p></p><p class="article-num" title="253篇文章"> 253篇文章</p><p class="article-num" title="排名:27445"> 排名:27445</p><p></p></div></div></div><div class="blog-expert-item"><div class="blog-expert-info-box"><div class="blog-expert-img-box" data-track-click="{"mod":"popu_709","con":"https://blog.csdn.net/zys_1997/article/details/78358992"}"><a href="https://blog.csdn.net/j2IaYU7Y" target="_blank"><img src="https://avatar.csdn.net/9/1/8/3_j2iayu7y.jpg" alt="IT派" title="IT派"></a><span data-track-click="{"mod":"popu_710","con":"https://blog.csdn.net/zys_1997/article/details/78358992"}"><span class="blog-expert-button-follow btn-red-follow" data-name="j2IaYU7Y" data-nick="IT派">关注</span></span></div><div class="info"><span data-track-click="{"mod":"popu_709","con":"https://blog.csdn.net/zys_1997/article/details/78358992"}"><a href="https://blog.csdn.net/j2IaYU7Y" target="_blank"><h5 class="oneline" title="IT派">IT派</h5></a></span> <p></p><p class="article-num" title="819篇文章"> 819篇文章</p><p class="article-num" title="排名:6977"> 排名:6977</p><p></p></div></div></div><div class="blog-expert-item"><div class="blog-expert-info-box"><div class="blog-expert-img-box" data-track-click="{"mod":"popu_709","con":"https://blog.csdn.net/zys_1997/article/details/78358992"}"><a href="https://blog.csdn.net/ygcxydzx" target="_blank"><img src="https://avatar.csdn.net/0/0/E/3_ygcxydzx.jpg" alt="程序员日常" title="程序员日常"></a><span data-track-click="{"mod":"popu_710","con":"https://blog.csdn.net/zys_1997/article/details/78358992"}"><span class="blog-expert-button-follow btn-red-follow" data-name="ygcxydzx" data-nick="程序员日常">关注</span></span></div><div class="info"><span data-track-click="{"mod":"popu_709","con":"https://blog.csdn.net/zys_1997/article/details/78358992"}"><a href="https://blog.csdn.net/ygcxydzx" target="_blank"><h5 class="oneline" title="程序员日常">程序员日常</h5></a></span> <p></p><p class="article-num" title="29篇文章"> 29篇文章</p><p class="article-num" title="排名:138902"> 排名:138902</p><p></p></div></div></div></div>
</div>
</div>
</div>
</div>
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/qq_32166627/article/details/53573974,BlogCommendFromBaidu_10,index_10"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/qq_32166627/article/details/53573974,BlogCommendFromBaidu_10,index_10"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_32166627/article/details/53573974" target="_blank" title="hadoop学习之azkaban(5):azkaban-2.5.0的详细安装过程">
<h4 class="text-truncate oneline" style="width: 862px;">
hadoop<em>学习</em>之azkaban(5):azkaban-2.5.0的详细安装过程 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/4/E/B/3_qq_32166627.jpg" alt="qq_32166627" class="avatar-pic">
<span class="namebox">
<span class="name">qq_32166627</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">12-11</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
1183</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_32166627/article/details/53573974" target="_blank" title="hadoop学习之azkaban(5):azkaban-2.5.0的详细安装过程">
<span class="desc oneline">一个完整的数据分析系统通常由大量的任务单元组成:比如shell脚本,java程序,mr程序,hive脚本等等。
各任务单元之间存在时间先后及前后依赖关系,为了很好地组织起这样的复杂执行计划,需要一个…
来自: 欢迎来到Jimmy的博客
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/qq_35875008/article/details/80239225,BlogCommendFromBaidu_11,index_11"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/qq_35875008/article/details/80239225,BlogCommendFromBaidu_11,index_11"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_35875008/article/details/80239225" target="_blank" title="大数据学习视频全套">
<h4 class="text-truncate oneline" style="width: 861px;">
<em>大数据</em><em>学习</em>视频全套 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/B/8/1/3_qq_35875008.jpg" alt="qq_35875008" class="avatar-pic">
<span class="namebox">
<span class="name">qq_35875008</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">05-08</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
1404</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_35875008/article/details/80239225" target="_blank" title="大数据学习视频全套">
<span class="desc oneline">各位友友: 本人这里有大量最近大数据高清视频,需要的密我:微信号:mark_cold 以下是部分视频截图:视频1:视频2:视频3:视频4:...</span>
</a>
<span class="blog_title_box oneline"><a target="_blank" href="https://blog.csdn.net/qq_35875008">来自: <span class="blog_title"> qq_35875008的博客</span></a></span>
</p>
</div>
</div>
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/feelinghappy/article/details/79345642,BlogCommendFromBaidu_12,index_12"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/feelinghappy/article/details/79345642,BlogCommendFromBaidu_12,index_12"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/feelinghappy/article/details/79345642" target="_blank" title="大数据学习">
<h4 class="text-truncate oneline" style="width: 869px;">
<em>大数据</em><em>学习</em> </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/4/C/5/3_feelinghappy.jpg" alt="feelinghappy" class="avatar-pic">
<span class="namebox">
<span class="name">feelinghappy</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">02-22</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
474</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/feelinghappy/article/details/79345642" target="_blank" title="大数据学习">
<span class="desc oneline">关系数据库管理系统(RDBMS)MySQL:世界最流行的开源数据库;PostgreSQL:世界最先进的开源数据库;Oracle 数据库:对象-关系型数据库管理系统。框架Apache Hadoop:分布...</span>
</a>
<span class="blog_title_box oneline"><a target="_blank" href="https://blog.csdn.net/feelinghappy">来自: <span class="blog_title"> feelinghappy的专栏</span></a></span>
</p>
</div>
</div>
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/gong_zhe_511/article/details/70692854,searchFromBaidu_13,index_13"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/gong_zhe_511/article/details/70692854,searchFromBaidu_13,index_13"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/gong_zhe_511/article/details/70692854" target="_blank" title="de/encodeURI(Component)--"http%3A%2F%2Fwww.baidu.com%2Fasd%3Fa%3D123"">
<h4 class="text-truncate oneline" style="width: 859px;">
de/encodeURI(Component)--"http%3A%2F%2Fwww.baidu.com%2Fasd%3Fa%3D123" </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/4/9/A/3_gong_zhe_511.jpg" alt="gong_zhe_511" class="avatar-pic">
<span class="namebox">
<span class="name">gong_zhe_511</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">04-25</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
1.1万</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/gong_zhe_511/article/details/70692854" target="_blank" title="de/encodeURI(Component)--"http%3A%2F%2Fwww.baidu.com%2Fasd%3Fa%3D123"">
<span class="desc oneline">对于”http%3A%2F%2Fwww.baidu.com%2Fasd%3Fa%3D123”这种特殊字符被转义成16进制的字符串, 虽然知道”%3A”表示冒号(百分号”%”是转义符, 相当于正则当中的...</span>
</a>
<span class="blog_title_box oneline"><a target="_blank" href="https://blog.csdn.net/gong_zhe_511">来自: <span class="blog_title"> hezz and gonng</span></a></span>
</p>
</div>
</div>
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/qq_35034912/article/details/53540695,searchFromBaidu_14,index_14"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/qq_35034912/article/details/53540695,searchFromBaidu_14,index_14"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_35034912/article/details/53540695" target="_blank" title="http://blog.csdn.net/account/register.html?from=http%3a%2f%2fwrite.blog.csdn.net%2f%3fticket%3dST-93">
<h4 class="text-truncate oneline" style="width: 862px;">
http://blog.csdn.net/account/register.html?from=http%3a%2f%2fwrite.blog.csdn.net%2f%3fticket%3dST-93 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/A/7/E/3_qq_35034912.jpg" alt="qq_35034912" class="avatar-pic">
<span class="namebox">
<span class="name">qq_35034912</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">12-09</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
1161</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_35034912/article/details/53540695" target="_blank" title="http://blog.csdn.net/account/register.html?from=http%3a%2f%2fwrite.blog.csdn.net%2f%3fticket%3dST-93">
<span class="desc oneline">org.xml.sax.SAXParseException; lineNumber: 174; columnNumber: 10; 元素类型为 "mapper" 的内容必须匹配 "(cache-ref...</span>
</a>
<span class="blog_title_box oneline"><a target="_blank" href="https://blog.csdn.net/qq_35034912">来自: <span class="blog_title"> Mayafor</span></a></span>
</p>
</div>
</div>
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/Simple_Bottle/article/details/71601497,searchFromBaidu_15,index_15"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/Simple_Bottle/article/details/71601497,searchFromBaidu_15,index_15"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/Simple_Bottle/article/details/71601497" target="_blank" title="error during connect: Get http://%2F%2F.%2Fpipe%2Fdocker_engine/v1.28/version: open //./pipe/docker_">
<h4 class="text-truncate oneline" style="width: 869px;">
error during connect: Get http://%2F%2F.%2Fpipe%2Fdocker_engine/v1.28/version: open //./pipe/docker_ </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/0/A/8/3_simple_bottle.jpg" alt="Simple_Bottle" class="avatar-pic">
<span class="namebox">
<span class="name">Simple_Bottle</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">05-11</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
668</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/Simple_Bottle/article/details/71601497" target="_blank" title="error during connect: Get http://%2F%2F.%2Fpipe%2Fdocker_engine/v1.28/version: open //./pipe/docker_">
<span class="desc oneline">错误原因:可能是之前我就安装了virtual box,与其自带不同,没有设定值吧。
ps:win10,Docker有原生的。不用docker tollbox
docker-machi…
来自: Simple学习心得
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/u012323351/article/details/50876417,searchFromBaidu_16,index_16"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/u012323351/article/details/50876417,searchFromBaidu_16,index_16"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/u012323351/article/details/50876417" target="_blank" title="PB 导入和导出Excel">
<h4 class="text-truncate oneline" style="width: 861px;">
PB 导入和导出Excel </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/2/8/B/3_u012323351.jpg" alt="u012323351" class="avatar-pic">
<span class="namebox">
<span class="name">u012323351</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">03-13</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
6671</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/u012323351/article/details/50876417" target="_blank" title="PB 导入和导出Excel">
<span class="desc oneline">integer li_rtn,ii,li_asc
string ls_name,ls_pathname
boolean lb_exist
if datawin.RowCount()
MessageB…
来自: 一切安好
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/wangshubo1989/article/details/78191456,searchFromBaidu_17,index_17"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/wangshubo1989/article/details/78191456,searchFromBaidu_17,index_17"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/wangshubo1989/article/details/78191456" target="_blank" title="Go实战--golang中操作PDF(rsc.io/pdf、jung-kurt/gofpdf、signintech/gopdf)">
<h4 class="text-truncate oneline" style="width: 861px;">
Go实战--golang中操作PDF(rsc.io/pdf、jung-kurt/gofpdf、signintech/gopdf) </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/9/0/3/3_wangshubo1989.jpg" alt="wangshubo1989" class="avatar-pic">
<span class="namebox">
<span class="name">wangshubo1989</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">10-10</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
8514</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/wangshubo1989/article/details/78191456" target="_blank" title="Go实战--golang中操作PDF(rsc.io/pdf、jung-kurt/gofpdf、signintech/gopdf)">
<span class="desc oneline">生命不止,继续 go go go !!!昨天介绍了golang中如何操作excel:
Go实战–golang中操作excel(tealeg/xlsx、360EntSecGroup-Skylar/ex…
来自: 一蓑烟雨任平生 也无风雨也无晴
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/qq_41800874/article/details/81560061,BlogCommendFromQuerySearch_18,index_18"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/qq_41800874/article/details/81560061,BlogCommendFromQuerySearch_18,index_18"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_41800874/article/details/81560061" target="_blank" title="零基础学习大数据:零基础学习大数据最完整的学习路线">
<h4 class="text-truncate oneline" style="width: 869px;">
零基础<em>学习</em><em>大数据</em>:零基础<em>学习</em><em>大数据</em>最完整的<em>学习</em><em>路线</em> </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/F/8/8/3_qq_41800874.jpg" alt="qq_41800874" class="avatar-pic">
<span class="namebox">
<span class="name">qq_41800874</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">08-10</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
338</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_41800874/article/details/81560061" target="_blank" title="零基础学习大数据:零基础学习大数据最完整的学习路线">
<span class="desc oneline"> 最近很多人都想学习大数据开发,但是却不知道如何开始学习,今天软妹子专门整理了一份针对大数据初学者的大数据开发学习路线。
下面分十个章节来说明大数据开发要学习的内容:
<div class="recommend-item-box recommend-box-ident recommend-download-box clearfix" data-track-view="{"mod":"popu_614","con":",https://download.csdn.net/download/u010885895/10041577,BlogCommendFromQuerySearch_19,index_19"}" data-track-click="{"mod":"popu_614","con":",https://download.csdn.net/download/u010885895/10041577,BlogCommendFromQuerySearch_19,index_19"}" data-flg="true">
<a href="https://download.csdn.net/download/u010885895/10041577" target="_blank">
<div class="content">
<div class="">
<span class="type">下载</span>
<h4 class="text-truncate oneline clearfix">
<em>大数据</em>从入门到精通<em>学习</em><em>路线</em> </h4>
<span class="data float-right">10-27</span>
</div>
<div class="desc oneline">
大数据从入门到精通学习路线,要下载工具xmind才能看,也可以自己改写,例如redis,mongodb,hbase,zookeeper,spark,docker,dubbo </div>
</div>
</a>
</div>
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/m0_37803704/article/details/80627541,BlogCommendFromQuerySearch_20,index_20"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/m0_37803704/article/details/80627541,BlogCommendFromQuerySearch_20,index_20"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/m0_37803704/article/details/80627541" target="_blank" title="大数据最佳学习路线总结">
<h4 class="text-truncate oneline" style="width: 869px;">
<em>大数据</em>最佳<em>学习</em><em>路线</em>总结 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/5/4/5/3_m0_37803704.jpg" alt="m0_37803704" class="avatar-pic">
<span class="namebox">
<span class="name">m0_37803704</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">06-08</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
386</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/m0_37803704/article/details/80627541" target="_blank" title="大数据最佳学习路线总结">
<span class="desc oneline">一,题记要说当下IT行业什么最火?ABC无出其右。所谓ABC者,AI + Big Data + Cloud也,即人工智能、大数据和云计算(云平台)。每个领域目前都有行业领袖在引领前行,今天我们来讨论下...</span>
</a>
<span class="blog_title_box oneline"><a target="_blank" href="https://blog.csdn.net/m0_37803704">来自: <span class="blog_title"> 假的鱼的博客</span></a></span>
</p>
</div>
</div>
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/j2IaYU7Y/article/details/80750662,BlogCommendFromQuerySearch_21,index_21"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/j2IaYU7Y/article/details/80750662,BlogCommendFromQuerySearch_21,index_21"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/j2IaYU7Y/article/details/80750662" target="_blank" title="Python数据分析与挖掘学习路线图">
<h4 class="text-truncate oneline" style="width: 869px;">
Python数据分析与挖掘<em>学习</em><em>路线</em>图 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/9/1/8/3_j2iayu7y.jpg" alt="j2IaYU7Y" class="avatar-pic">
<span class="namebox">
<span class="name">j2IaYU7Y</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">06-19</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
579</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/j2IaYU7Y/article/details/80750662" target="_blank" title="Python数据分析与挖掘学习路线图">
<span class="desc oneline">
...</span>
</a>
<span class="blog_title_box oneline"><a target="_blank" href="https://blog.csdn.net/j2IaYU7Y">来自: <span class="blog_title"> IT派</span></a></span>
</p>
</div>
</div>
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/ygcxydzx/article/details/82781572,BlogCommendFromQuerySearch_22,index_22"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/ygcxydzx/article/details/82781572,BlogCommendFromQuerySearch_22,index_22"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/ygcxydzx/article/details/82781572" target="_blank" title="史上最新最全面的java大数据学习路线(新手小白必看版本)">
<h4 class="text-truncate oneline" style="width: 869px;">
史上最新最全面的java<em>大数据</em><em>学习</em><em>路线</em>(新手小白必看版本) </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/0/0/E/3_ygcxydzx.jpg" alt="ygcxydzx" class="avatar-pic">
<span class="namebox">
<span class="name">ygcxydzx</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">09-20</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
294</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/ygcxydzx/article/details/82781572" target="_blank" title="史上最新最全面的java大数据学习路线(新手小白必看版本)">
<span class="desc oneline">第一阶段:大数据基础Java语言基础阶段
1.1:Java开发介绍
1.1.1 Java的发展历史
1.1.2 Java的应用领域
1.1.3 Java语言的特性
1.1.4 Java面向对…
来自: 千锋官方的博客
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/CSDN_fzs/article/details/78984845,BlogCommendFromBaidu_23,index_23"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/CSDN_fzs/article/details/78984845,BlogCommendFromBaidu_23,index_23"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/CSDN_fzs/article/details/78984845" target="_blank" title="大数据学习路线(完整详细版)">
<h4 class="text-truncate oneline" style="width: 859px;">
<em>大数据</em><em>学习</em><em>路线</em>(完整详细版) </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/7/5/0/3_csdn_fzs.jpg" alt="CSDN_fzs" class="avatar-pic">
<span class="namebox">
<span class="name">CSDN_fzs</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">01-05</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
3.2万</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/CSDN_fzs/article/details/78984845" target="_blank" title="大数据学习路线(完整详细版)">
<span class="desc oneline">大数据学习路线
java(Java se,javaweb)
Linux(shell,高并发架构,lucene,solr)
Hadoop(Hadoop,HDFS,Mapreduce,yarn,…
来自: CSDN_fzs的博客
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/qq646748739/article/details/70234941,BlogCommendFromBaidu_24,index_24"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/qq646748739/article/details/70234941,BlogCommendFromBaidu_24,index_24"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq646748739/article/details/70234941" target="_blank" title="Hive学习路线图">
<h4 class="text-truncate oneline" style="width: 869px;">
Hive<em>学习</em><em>路线</em>图 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/6/C/9/3_qq646748739.jpg" alt="qq646748739" class="avatar-pic">
<span class="namebox">
<span class="name">qq646748739</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">04-19</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
246</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq646748739/article/details/70234941" target="_blank" title="Hive学习路线图">
<span class="desc oneline">Hive学习路线图
Hadoop家族系列文章,主要介绍Hadoop家族产品,常用的项目包括Hadoop,
Hive, Pig, HBase, Sqoop, Mahout, Zookeeper…
来自: qq646748739的专栏
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/zhubing10061210/article/details/73456944,BlogCommendFromBaidu_25,index_25"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/zhubing10061210/article/details/73456944,BlogCommendFromBaidu_25,index_25"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/zhubing10061210/article/details/73456944" target="_blank" title="大数据经典学习路线(storm,spark)">
<h4 class="text-truncate oneline" style="width: 861px;">
<em>大数据</em>经典<em>学习</em><em>路线</em>(storm,spark) </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/F/4/F/3_zhubing10061210.jpg" alt="zhubing10061210" class="avatar-pic">
<span class="namebox">
<span class="name">zhubing10061210</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">06-19</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
4666</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/zhubing10061210/article/details/73456944" target="_blank" title="大数据经典学习路线(storm,spark)">
<span class="desc oneline">1.Linux基础和分布式集群技术
学完此阶段可掌握的核心能力:
熟练使用linux,熟练安装Linux上的软件,了解熟悉负载均衡、高可靠等集群相关概念,搭建互联网高并发、高可靠的服务…
来自: zhubing10061210的博客
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/xx666zz/article/details/80067777,BlogCommendFromBaidu_26,index_26"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/xx666zz/article/details/80067777,BlogCommendFromBaidu_26,index_26"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/xx666zz/article/details/80067777" target="_blank" title="大数据学习书籍">
<h4 class="text-truncate oneline" style="width: 861px;">
<em>大数据</em><em>学习</em>书籍 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/0/A/1/3_xx666zz.jpg" alt="xx666zz" class="avatar-pic">
<span class="namebox">
<span class="name">xx666zz</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">04-24</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
2256</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/xx666zz/article/details/80067777" target="_blank" title="大数据学习书籍">
<span class="desc oneline"> 大数据火爆招聘中,高端的薪资待遇实在是让人欲罢不能,赶紧拿起书本,原来学习大数据才是正道。可是看到很多漫天大数据的书籍真的有些头疼了,不知道该从哪一本开始阅读。 学习这种事,泛泛而读真的不如术业...</span>
</a>
<span class="blog_title_box oneline"><a target="_blank" href="https://blog.csdn.net/xx666zz">来自: <span class="blog_title"> xx666zz的博客</span></a></span>
</p>
</div>
</div>
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/qq_36510261/article/details/78189888,BlogCommendFromBaidu_27,index_27"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/qq_36510261/article/details/78189888,BlogCommendFromBaidu_27,index_27"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_36510261/article/details/78189888" target="_blank" title="【大数据学习】数学基础及应用">
<h4 class="text-truncate oneline" style="width: 861px;">
【<em>大数据</em><em>学习</em>】数学基础及应用 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/A/4/B/3_qq_36510261.jpg" alt="qq_36510261" class="avatar-pic">
<span class="namebox">
<span class="name">qq_36510261</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">10-10</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
2090</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_36510261/article/details/78189888" target="_blank" title="【大数据学习】数学基础及应用">
<span class="desc oneline">课程介绍
本课程主要介绍大数据中的数学基础:
一、向量、矩阵介绍
二、向量在游戏引擎中的应用
三、矩阵奇异值分解及其应用
四、导数、梯度介绍
五、最优化方法及其应用
课时列表
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/Wilhelmina_Carmel/article/details/78252516,BlogCommendFromBaidu_29,index_28"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/Wilhelmina_Carmel/article/details/78252516,BlogCommendFromBaidu_29,index_28"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/Wilhelmina_Carmel/article/details/78252516" target="_blank" title="从小白到大数据技术专家的学习历程">
<h4 class="text-truncate oneline" style="width: 869px;">
从小白到<em>大数据</em>技术专家的<em>学习</em>历程 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/C/B/E/3_wilhelmina_carmel.jpg" alt="Wilhelmina_Carmel" class="avatar-pic">
<span class="namebox">
<span class="name">Wilhelmina_Carmel</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">10-16</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
879</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/Wilhelmina_Carmel/article/details/78252516" target="_blank" title="从小白到大数据技术专家的学习历程">
<span class="desc oneline">那大数据处置技术怎样学习呢?首先我们要学习Java言语和Linux操作系统,这两个是学习大数据的基础,学习的顺序不分前后。#
Java:大家都知道Java的方向有JavaSE、JavaEE、Ja…
来自: 海牛大数据的博客
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/leonpengweicn/article/details/32334137,searchFromBaidu_30,index_29"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/leonpengweicn/article/details/32334137,searchFromBaidu_30,index_29"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/leonpengweicn/article/details/32334137" target="_blank" title="go test 测试单个文件和测试单个函数">
<h4 class="text-truncate oneline" style="width: 859px;">
go test 测试单个文件和测试单个函数 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/4/1/F/3_leonpengweicn.jpg" alt="leonpengweicn" class="avatar-pic">
<span class="namebox">
<span class="name">leonpengweicn</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">06-19</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
1.6万</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/leonpengweicn/article/details/32334137" target="_blank" title="go test 测试单个文件和测试单个函数">
<span class="desc oneline">1,测试单个文件</span>
</a>
<span class="blog_title_box oneline"><a target="_blank" href="https://blog.csdn.net/leonpengweicn">来自: <span class="blog_title"> leonpengweicn的专栏</span></a></span>
</p>
</div>
</div>
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/e_wsq/article/details/78218716,searchFromBaidu_31,index_30"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/e_wsq/article/details/78218716,searchFromBaidu_31,index_30"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/e_wsq/article/details/78218716" target="_blank" title="Visual Studio 下载">
<h4 class="text-truncate oneline" style="width: 861px;">
Visual Studio 下载 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/8/A/D/3_e_wsq.jpg" alt="e_wsq" class="avatar-pic">
<span class="namebox">
<span class="name">e_wsq</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">10-12</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
1019</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/e_wsq/article/details/78218716" target="_blank" title="Visual Studio 下载">
<span class="desc oneline">https://www.visualstudio.com/zh-hans/downloads/?rr=http%3A%2F%2Fblog.csdn.net%2Fcsdnnews%2Farticle%2...</span>
</a>
<span class="blog_title_box oneline"><a target="_blank" href="https://blog.csdn.net/e_wsq">来自: <span class="blog_title"> 冷月宫主的专栏</span></a></span>
</p>
</div>
</div>
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/a745233700/article/details/79321245,searchFromBaidu_32,index_31"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/a745233700/article/details/79321245,searchFromBaidu_32,index_31"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/a745233700/article/details/79321245" target="_blank" title="java通过SMS短信平台实现发短信的功能">
<h4 class="text-truncate oneline" style="width: 861px;">
java通过SMS短信平台实现发短信的功能 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/4/B/1/3_a745233700.jpg" alt="a745233700" class="avatar-pic">
<span class="namebox">
<span class="name">a745233700</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">02-13</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
1625</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/a745233700/article/details/79321245" target="_blank" title="java通过SMS短信平台实现发短信的功能">
<span class="desc oneline">一、使用java发送短信的方法:
java发送手机短信,通常有几种方法:
(1)使用webserive接口发送手机短信;
(2)使用短信猫的方式进行短信的发送,比较常用的方式,不过需要购买硬件设…
来自: a745233700的博客
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/qq_26058749/article/details/52791973,searchFromBaidu_33,index_32"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/qq_26058749/article/details/52791973,searchFromBaidu_33,index_32"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_26058749/article/details/52791973" target="_blank" title="<四> 内核的配置和编译">
<h4 class="text-truncate oneline" style="width: 869px;">
<四> 内核的配置和编译 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/B/D/D/3_qq_26058749.jpg" alt="qq_26058749" class="avatar-pic">
<span class="namebox">
<span class="name">qq_26058749</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">10-11</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
381</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_26058749/article/details/52791973" target="_blank" title="<四> 内核的配置和编译">
<span class="desc oneline">编译内核 配置内核 拷贝标准板配置文件 修改内核顶层目录下的 Makefile 解压内核 内核的配置和编译...</span>
</a>
<span class="blog_title_box oneline"><a target="_blank" href="https://blog.csdn.net/qq_26058749">来自: <span class="blog_title"> 冲天菜鸟的博客</span></a></span>
</p>
</div>
</div>
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/qq_41800874/article/details/81354480,BlogCommendFromQuerySearch_34,index_33"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/qq_41800874/article/details/81354480,BlogCommendFromQuerySearch_34,index_33"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_41800874/article/details/81354480" target="_blank" title="干货分享 | 大数据零基础学习路线:新手从入门到精通">
<h4 class="text-truncate oneline" style="width: 869px;">
干货分享 | <em>大数据</em>零基础<em>学习</em><em>路线</em>:新手从入门到精通 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/F/8/8/3_qq_41800874.jpg" alt="qq_41800874" class="avatar-pic">
<span class="namebox">
<span class="name">qq_41800874</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">08-02</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
386</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_41800874/article/details/81354480" target="_blank" title="干货分享 | 大数据零基础学习路线:新手从入门到精通">
<span class="desc oneline">很多初学者在萌生向大数据方向发展的想法之后,不免产生一些疑问,应该怎样入门?应该学习哪些技术?学习路线又是什么?
所有萌生入行的想法与想要学习Java的同学的初衷是一样的。岗位非常火…
来自: qq_41800874的博客
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/qq_23832313/article/details/81115964,BlogCommendFromQuerySearch_35,index_34"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/qq_23832313/article/details/81115964,BlogCommendFromQuerySearch_35,index_34"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_23832313/article/details/81115964" target="_blank" title="java转大数据的学习路线">
<h4 class="text-truncate oneline" style="width: 861px;">
java转<em>大数据</em>的<em>学习</em><em>路线</em> </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/0/8/A/3_qq_23832313.jpg" alt="qq_23832313" class="avatar-pic">
<span class="namebox">
<span class="name">qq_23832313</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">07-19</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
1608</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_23832313/article/details/81115964" target="_blank" title="java转大数据的学习路线">
<span class="desc oneline">首先这个文章是转载的,留着后面基础再扎实一点之后开始学习,感谢原文的作者,写出了如此清晰的学习路线。原文作者文章链接:https://blog.csdn.net/gitchat/article/det...</span>
</a>
<span class="blog_title_box oneline"><a target="_blank" href="https://blog.csdn.net/qq_23832313">来自: <span class="blog_title"> 小雪的博客</span></a></span>
</p>
</div>
</div>
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/basycia/article/details/52927742,BlogCommendFromQuerySearch_36,index_35"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/basycia/article/details/52927742,BlogCommendFromQuerySearch_36,index_35"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/basycia/article/details/52927742" target="_blank" title="大数据云计算学习路线">
<h4 class="text-truncate oneline" style="width: 870px;">
<em>大数据</em>云计算<em>学习</em><em>路线</em> </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/8/1/0/3_basycia.jpg" alt="basycia" class="avatar-pic">
<span class="namebox">
<span class="name">basycia</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">10-25</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
1万</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/basycia/article/details/52927742" target="_blank" title="大数据云计算学习路线">
<span class="desc oneline">大数据、云计算系统顶级架构师课程学习路线图
大数据之Linux+大数据开发篇
Java Linux基础 Shell编程 Hadoop2.x HDFS YARN MapReduce ETL数据清洗H…
来自: basycai的博客
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/qq_37187606/article/details/80669708,BlogCommendFromQuerySearch_37,index_36"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/qq_37187606/article/details/80669708,BlogCommendFromQuerySearch_37,index_36"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_37187606/article/details/80669708" target="_blank" title="大数据云计算学习路线分析(纯属个人看法和观点)">
<h4 class="text-truncate oneline" style="width: 869px;">
<em>大数据</em>云计算<em>学习</em><em>路线</em>分析(纯属个人看法和观点) </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/8/1/C/3_qq_37187606.jpg" alt="qq_37187606" class="avatar-pic">
<span class="namebox">
<span class="name">qq_37187606</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">06-12</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
289</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_37187606/article/details/80669708" target="_blank" title="大数据云计算学习路线分析(纯属个人看法和观点)">
<span class="desc oneline">1.Linux基础和Hadoop分布式架构计算处理模块学完此阶段可掌握的核心能力:熟练使用Linux,熟练安装Linux上的软件,了解熟悉负载均衡、高可靠等集群相关概念,搭建互联网高并发、高可靠的服务...</span>
</a>
<span class="blog_title_box oneline"><a target="_blank" href="https://blog.csdn.net/qq_37187606">来自: <span class="blog_title"> qq_37187606的博客</span></a></span>
</p>
</div>
</div>
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/m2606707610/article/details/80600777,BlogCommendFromQuerySearch_38,index_37"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/m2606707610/article/details/80600777,BlogCommendFromQuerySearch_38,index_37"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/m2606707610/article/details/80600777" target="_blank" title="JAVA大数据学习路线">
<h4 class="text-truncate oneline" style="width: 869px;">
JAVA<em>大数据</em><em>学习</em><em>路线</em> </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/B/D/B/3_m2606707610.jpg" alt="m2606707610" class="avatar-pic">
<span class="namebox">
<span class="name">m2606707610</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">06-06</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
423</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/m2606707610/article/details/80600777" target="_blank" title="JAVA大数据学习路线">
<span class="desc oneline">背景近年来大数据BigData、人工智能AI、物联网Iot等行业发展迅猛,很多人都想要从事大数据技术开发工作,但是,请问要怎么做,路线是什么?从哪里开始学?学哪些?这是一个大问题。对于我自己来说,最近...</span>
</a>
<span class="blog_title_box oneline"><a target="_blank" href="https://blog.csdn.net/m2606707610">来自: <span class="blog_title"> m2606707610的博客</span></a></span>
</p>
</div>
</div>
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/tian31233/article/details/55511631,BlogCommendFromBaidu_39,index_38"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/tian31233/article/details/55511631,BlogCommendFromBaidu_39,index_38"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/tian31233/article/details/55511631" target="_blank" title="大数据学习线路">
<h4 class="text-truncate oneline" style="width: 861px;">
<em>大数据</em><em>学习</em>线路 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/E/E/2/3_tian31233.jpg" alt="tian31233" class="avatar-pic">
<span class="namebox">
<span class="name">tian31233</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">02-17</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
4384</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/tian31233/article/details/55511631" target="_blank" title="大数据学习线路">
<span class="desc oneline">第一阶段:Linux课程
讲解linux基础操作,讲的是在命令行下进行文件系统的操作,这是hadoop学习的基础,后面的所有视频都是基于linux操作的。鉴于很多学员没有linux基础,特增加该内容…
来自: tian31233的专栏
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/shooke/article/details/53418313,BlogCommendFromBaidu_40,index_39"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/shooke/article/details/53418313,BlogCommendFromBaidu_40,index_39"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/shooke/article/details/53418313" target="_blank" title="大数据工程师学习路线图">
<h4 class="text-truncate oneline" style="width: 861px;">
<em>大数据</em>工程师<em>学习</em><em>路线</em>图 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/3/0/C/3_shooke.jpg" alt="shooke" class="avatar-pic">
<span class="namebox">
<span class="name">shooke</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">12-01</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
2015</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/shooke/article/details/53418313" target="_blank" title="大数据工程师学习路线图">
<span class="desc oneline">大数据工程师学习路线图
课程介绍
本大数据课程根据企业实际需求,采用“根雕教育”,经典案例式教学,为培养企业大数据急需的人才而开设课程。该课程包含Hadoop技术、Spark技术、HBase等热门…
来自: shooke笔记
<div class="recommend-item-box recommend-box-ident recommend-download-box clearfix" data-track-view="{"mod":"popu_614","con":",https://download.csdn.net/download/a58gg/10125991,BlogCommendFromBaidu_41,index_40"}" data-track-click="{"mod":"popu_614","con":",https://download.csdn.net/download/a58gg/10125991,BlogCommendFromBaidu_41,index_40"}" data-flg="true">
<a href="https://download.csdn.net/download/a58gg/10125991" target="_blank">
<div class="content">
<div class="">
<span class="type">下载</span>
<h4 class="text-truncate oneline clearfix">
华为开发者社区<em>大数据</em>培训文档 </h4>
<span class="data float-right">11-20</span>
</div>
<div class="desc oneline">
华为开发者社区大数据培训文档 通俗易懂的大数据资料 </div>
</div>
</a>
</div>
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/xxssyyyyssxx/article/details/49735393,BlogCommendFromBaidu_42,index_41"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/xxssyyyyssxx/article/details/49735393,BlogCommendFromBaidu_42,index_41"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/xxssyyyyssxx/article/details/49735393" target="_blank" title="大数据学习路径(尚学堂版)">
<h4 class="text-truncate oneline" style="width: 861px;">
<em>大数据</em><em>学习</em>路径(尚学堂版) </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/5/C/1/3_xxssyyyyssxx.jpg" alt="xxssyyyyssxx" class="avatar-pic">
<span class="namebox">
<span class="name">xxssyyyyssxx</span>
<span class="triangle"></span>
</span>
</p> -->
<p class="date-and-readNum">
<span class="date hover-show">11-09</span>
<span class="read-num hover-hide">
<svg class="icon csdnc-yuedushu" aria-hidden="true">
<use xlink:href="#csdnc-m-passwords-visible"></use>
</svg>
4364</span>
</p>
</div>
</a>
<p class="content" style="width: 952px;">
<a href="https://blog.csdn.net/xxssyyyyssxx/article/details/49735393" target="_blank" title="大数据学习路径(尚学堂版)">
<span class="desc oneline">来自尚学堂
http://www.bjsxt.com/html/cloud/
来自: 熊诗言的博客
<div class="recommend-item-box recommend-box-ident type_blog clearfix" data-track-view="{"mod":"popu_614","con":",https://blog.csdn.net/qq_36648909/article/details/53083787,BlogCommendFromBaidu_43,index_42"}" data-track-click="{"mod":"popu_614","con":",https://blog.csdn.net/qq_36648909/article/details/53083787,BlogCommendFromBaidu_43,index_42"}" data-flg="true">
<div class="content" style="width: 952px;">
<a href="https://blog.csdn.net/qq_36648909/article/details/53083787" target="_blank" title="大数据学习入门级书籍推荐">
<h4 class="text-truncate oneline" style="width: 861px;">
<em>大数据</em><em>学习</em>入门级书籍推荐 </h4>
<div class="info-box d-flex align-content-center">
<!-- <p class="avatar">
<img src="https://avatar.csdn.net/C/1/A/3_qq_36648909.jpg" alt="qq_36648909" class="avatar-pic">
<span class="namebox">
<span class="name"