PySpark Overview
PySpark概述
Date: Sep 09, 2023 Version: 3.5.0
日期:2023年9月9日 版本:3.5.0
PySpark is the Python API for Apache Spark. It enables you to perform real-time, large-scale data processing in a distributed environment using Python. It also provides a PySpark shell for interactively analyzing your data.
PySpark是Apache Spark的Python API。它使您能够使用Python在分布式环境中执行实时,大规模的数据处理。它还提供了一个PySpark shell,用于交互式地分析数据。
PySpark combines Python’s learnability and ease of use with the power of Apache Spark to enable processing and analysis of data at any size for everyone familiar with Python.
PySpark将Python的易学性和易用性与Apache Spark的强大功能相结合,使任何熟悉Python的人都可以处理和分析任何大小的数据。
PySpark supports all of Spark’s features such as Spark SQL, DataFrames, Structured Streaming, Machine Learning (MLlib) and Spark Core.
PySpark支持Spark的所有功能,例如Spark SQL,DataFrames,结构化流,机器学习(MLlib)和Spark Core。