Lesson18

###Lesson 18: Big Data

####Slides

• Lesson 18 Slides

####Handouts

• PySpark

####Spark Installation: If you'd like to follow along with the Spark notebook you can attempt to install Spark locally so that you can run the PySpark manipulations (these instructions are for a Mac).

1. Install Spark on your Mac by following the directions here
2. If necessary, make the adjustments to the launch jar file as seen here
3. Follow the instructions here to get the notebook working with PySpark within IPython. A copy of the 00-pyspark-setup.py file that worked for me has been included on the repo.
4. Try loading the notebook and see if it works for you.