spark数据分析基于python语言 中文版pdf_Spark数据分析:基于Python语言

译者序

前言

引言

第一部分 Spark基础

第1章 大数据、Hadoop、Spark介绍 2

1.1 大数据、分布式计算、Hadoop简介 2

1.1.1 大数据与Hadoop简史 2

1.1.2 Hadoop简介 3

1.2 Spark简介 8

1.2.1 Spark背景 9

1.2.2 Spark的用途 9

1.2.3 Spark编程接口 9

1.2.4 Spark程序的提交类型 10

1.2.5 Spark应用程序的输入/输出类型 11

1.2.6 Spark中的RDD 11

1.2.7 Spark与Hadoop 11

1.3 Python函数式编程 12

1.3.1 Python函数式编程中的数据结构 12

1.3.2 Python对象序列化 15

1.3.3 Python函数式编程基础 17

1.4 本章小结 19

第2章 部署Spark 20

2.1 Spark部署模式 20

2.1.1 本地模式 21

2.1.2 Spark独立集群 21

2.1.3 基于YARN运行Spark 22

2.1.4 基于Mesos运行Spark 22

2.2 准备安装Spark 23

2.3 获取Spark 23

2.4 在Linux或Mac OS X上安装Spark 25

2.5 在Windows上安装Spark 26

2.6 探索Spark安装目录 28

2.7 部署多节点的Spark独立集群 29

2.8 在云上部署Spark 30

2.8.1 AWS 30

2.8.2 GCP

  • 0
    点赞
  • 1
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
Paperback: 146 pages Publisher: Packt Publishing - ebooks Account (February 4, 2016) Language: English ISBN-10: 1784399698 ISBN-13: 978-1784399696 Key Features Set up real-time streaming and batch data intensive infrastructure using Spark and Python Deliver insightful visualizations in a web app using Spark (PySpark) Inject live data using Spark Streaming with real-time events Book Description Looking for a cluster computing system that provides high-level APIs? Apache Spark is your answer―an open source, fast, and general purpose cluster computing system. Spark's multi-stage memory primitives provide performance up to 100 times faster than Hadoop, and it is also well-suited for machine learning algorithms. Are you a Python developer inclined to work with Spark engine? If so, this book will be your companion as you create data-intensive app using Spark as a processing engine, Python visualization libraries, and web frameworks such as Flask. To begin with, you will learn the most effective way to install the Python development environment powered by Spark, Blaze, and Bookeh. You will then find out how to connect with data stores such as MySQL, MongoDB, Cassandra, and Hadoop. You'll expand your skills throughout, getting familiarized with the various data sources (Github, Twitter, Meetup, and Blogs), their data structures, and solutions to effectively tackle complexities. You'll explore datasets using iPython Notebook and will discover how to optimize the data models and pipeline. Finally, you'll get to know how to create training datasets and train the machine learning models. By the end of the book, you will have created a real-time and insightful trend tracker data-intensive app with Spark.

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值