Key Learnings
- Learn how to interact with Jupyter notebook environment
- Initialize a Spark application and interact with SparkContext
- Create and use Spark RDD (Resilient Distributed Datasets)
- Create and use Spark DataFrame
- Explore and query the data using Spark DataFrame API
- Perform statistical analysis on our data using Spark SQL
- Save and retrieve results from Parque