Speaker
Description
A comprehensive learning experience tailored to equip participants with the knowledge
and practical skills necessary to excel in the dynamic field of data engineering and big data processing. Practical session participants will be using Databricks https://community.cloud.databricks.com/login.html
Learning Objectives
- Understand the key concepts of data engineering and big data processing.
- Describe the architecture and functionalities of Apache Spark.
- Utilize Spark SQL and Data Frames for data querying and analysis.
- Perform data transformations and aggregations using Spark functions.
Pre-requisites
- Basic understanding of programming concepts (Python)
- Familiarity with relational databases
- Understanding data warehousing concepts and ETL process (advantageous but not mandatory)
- Recommended STFC Training: Enrol for free then watch video Practical Guide to Data Engineering
