Apache Spark tutorial with Python!

https://www.udemy.com/course/taming-big-data-with-apache-spark-hands-on https://github.com/PacktPublishing/Frank-Kanes-Taming-Big-Data-with-Apache-Spark-and-Python https://github.com/paisit04/udemy-spark

Getting Set Up

https://sundog-education.com/spark-python/

Running pyspark

docker-compose up spark
docker-compose exec spark bash
pyspark

MovieLens download location

http://media.sundog-soft.com/es/ml-100k.zip

Running your first Spark program

spark-submit ratings-counter.py 

Doc

https://spark.apache.org/docs/2.2.0/api/python/pyspark.sql.html