Modern Data Warehouses & Data Lakes

In this course you will learn:

• How to use Data Lakes, Data Warehouses, and BI tools in a unified system
• How to load data into Data Lakes and visualize it in reports
• How to build integrations in Google Cloud Platform and AWS
• How ETL/ELT architecture works and how to apply it in modern data warehouses

Basics of Data Warehouses and Data Lakes

• The role of data warehouses in analytical platforms
• How data is loaded into Data Warehouse through ETL/ELT
• What Data Lakes are and how to use them
• How to work with files directly in the data lake

Practice on GCP: Cloud Storage, BigQuery, and Data Studio

• Setting up Cloud Storage, creating a table in BigQuery
• Data visualization in Data Studio
• Understanding the general principles of cloud platforms

Practice on AWS: S3, Athena, Glue, and Quicksight

• Creating data integration through S3, Athena, and Quicksight
• Setting up Glue Data Catalog for data management
• Detailed setup and integration of Glue

Summary and bonus lesson: AWS Redshift Spectrum

• Course summary
• Additional module on working with Redshift Spectrum using the prepared Data Catalog from the AWS project

Required knowledge

• Basics of working with Data Warehouses (it is recommended to take the "Data Warehouses" course in the academy)
• Basic knowledge of AWS Athena and Redshift (for the block with Redshift Spectrum, a prepared Data Catalog from the AWS project is used)

This course will help you master modern approaches to building data storage and processing systems and learn how to effectively use the capabilities of Data Lakes and Data Warehouses for analytics.