Spark

14 May 2018 in Getting Started on Spark

Installation

http://spark.apache.org/downloads.html

REPL(Read Eval Print Loop)

$ park-shell

$ pyspark

Example

$ pwd
/home/vagrant/spark

$ run-example SparkPi
Pi is roughly 3.137940

$ spark-submit examples/src/main/python/pi.py 
Pi is roughly 3.137940