Lightning-fast unified analytics engine

Apache Spark™ is a unified analytics engine for large-scale data processing.


run workloads 100x faster.

3d南方双彩网专家预测 apache spark achieves high performance for both batch and streaming data, using a state-of-the-art dag scheduler, a query optimizer, and a physical execution engine.

Logistic regression in Hadoop and Spark

Ease of Use

3d南方双彩网专家预测 write applications quickly in java, scala, python, r, and sql.

Spark offers over 80 high-level operators that make it easy to build parallel apps. And you can use it interactively from the Scala, Python, R, and SQL shells.

df = spark.read.json("logs.json") df.where("age > 21")   .select("name.first").show()
Spark's Python DataFrame API
Read JSON files with automatic schema inference


combine sql, streaming, and complex analytics.

Spark powers a stack of libraries including SQL and DataFrames, MLlib for machine learning, GraphX, and Spark Streaming3d南方双彩网专家预测. You can combine these libraries seamlessly in the same application.

Spark SQL Spark Streaming MLlib (machine learning) GraphX

Runs Everywhere

spark runs on hadoop, apache mesos, kubernetes, standalone, or in the cloud. it can access diverse data sources.

You can run Spark using its standalone cluster mode3d南方双彩网专家预测, on , on , on , or on . Access data in , , , , , and hundreds of other data sources.


Spark is used at a wide range of organizations to process large datasets. You can find many example use cases on the Powered By3d南方双彩网专家预测 page.

3d南方双彩网专家预测 there are many ways to reach the community:


3d南方双彩网专家预测 apache spark is built by a wide set of developers from over 300 companies. since 2009, more than 1200 developers have contributed to spark!

The project's committers3d南方双彩网专家预测 come from more than 25 organizations.

If you'd like to participate in Spark, or contribute to the libraries on top of it, learn how to contribute.


learning apache spark is easy whether you come from a java, scala, python, r, or sql background:

2元中国福利彩票怎么看 2元彩票双色球走势图双色球 2元就可以打1毛的斗地主棋牌 2元中国福利彩票的买法 2元买彩票选几个数字 2元彩票刮刮乐 2元彩票 2元彩不错 2元彩票网专家杀号排列三 2元彩票网体彩排列三