• {Load {Files}
• Transform}

• {RDD, DataFrame, DataSet
• Data Sources
• Transformations}

• {Repository
• CI/CD
• Streaming
• Performance}

• Unified Engine

• Large-scale Data

• https://spark.apache.org/docs/latest/sql-programming-guide.html

• https://spark.apache.org/docs/latest/api/scala/org/apache/spark/sql/Dataset.html

• https://spark.apache.org/docs/latest/api/scala/org/apache/spark/sql/functions$.html

https://databricks.com/

https://community.cloud.databricks.com/login.html

https://portal.azure.com

• {Load {Files}

• DataFrame

• Transform}

• {Code Repo

• CI/CD

• Streaming

• Performance}

​                  ( Optimization & Tuning )