08-Summary-Tiered-Architecture.md

Tiered Architecture

Level 0:

• HDFS File System - Collates all of the inputed information

Level 1:

• Hive Tables System and Spark
  • Processing interface (Hive)
  • Analysis Engine (Spark)

Level 2:

• PySpark - Act as an interface between Spark and Python
• Sparklyr - Act as an interface between Spark and R
• ShinyServer - Allow information to be communicated rapidly

Level 3:

• R, RStudio, Tidyverse
• Python