2.3.0配置 spark_Spark Authorizer支持最新版本Spark 2.3.0

最新推荐文章于 2022-09-22 12:28:38 发布

weixin_39653361

最新推荐文章于 2022-09-22 12:28:38 发布

阅读量92

点赞数

文章标签： 2.3.0配置 spark

本文链接：https://blog.csdn.net/weixin_39653361/article/details/111496754

版权

今天Spark社区为大家带来了最新的Spark 2.3.0

Spark Release 2.3.0

Apache Spark 2.3.0 is the fourth release in the 2.x line. This release adds support for Continuous Processing in Structured Streaming along with a brand new Kubernetes Scheduler backend. Other major updates include the new DataSource and Structured Streaming v2 APIs, and a number of PySpark performance enhancements. In addition, this release continues to focus on usability, stability, and polish while resolving around 1400 tickets.

To download Apache Spark 2.3.0, visit the downloads page. You can consult JIRA for the detailed changes. We have curated a list of high level changes here, grouped by major modules.

Spark Authorizer权限管理插件现已支持spark 2.3.0

GitHup repo: https://github.com/yaooqinn/spark-authorizer

Branch：Spark-2.3

也可基于spark依赖参数--packages直接使用

$SPARK_HOME/bin/spark-shell --packages yaooqinn:spark-authorizer:1.0.0.spark2.3