Modern Data Warehouses & Data Lakes

58m 9s
English
Paid
As a data engineer, you will regularly work with analytical platforms where companies store data in Data Lakes and Data Warehouses for building visualizations and creating machine learning models. Modern data warehouses, such as AWS Redshift, Google BigQuery, and Snowflake, allow you to load data directly from files in a Data Lake. This integration makes working with warehouses flexible and convenient for analytical tasks.
Read more about the course

In this course you will learn:

  • How to use Data Lakes, Data Warehouses, and BI tools in a unified system
  • How to load data into Data Lakes and visualize it in reports
  • How to build integrations in Google Cloud Platform and AWS
  • How ETL/ELT architecture works and how to apply it in modern data warehouses

Basics of Data Warehouses and Data Lakes

  • The role of data warehouses in analytical platforms
  • How data is loaded into Data Warehouse through ETL/ELT
  • What Data Lakes are and how to use them
  • How to work with files directly in the data lake

Practice on GCP: Cloud Storage, BigQuery, and Data Studio

  • Setting up Cloud Storage, creating a table in BigQuery
  • Data visualization in Data Studio
  • Understanding the general principles of cloud platforms

Practice on AWS: S3, Athena, Glue, and Quicksight

  • Creating data integration through S3, Athena, and Quicksight
  • Setting up Glue Data Catalog for data management
  • Detailed setup and integration of Glue

Summary and bonus lesson: AWS Redshift Spectrum

  • Course summary
  • Additional module on working with Redshift Spectrum using the prepared Data Catalog from the AWS project

Required knowledge

  • Basics of working with Data Warehouses (it is recommended to take the "Data Warehouses" course in the academy)
  • Basic knowledge of AWS Athena and Redshift (for the block with Redshift Spectrum, a prepared Data Catalog from the AWS project is used)

This course will help you master modern approaches to building data storage and processing systems and learn how to effectively use the capabilities of Data Lakes and Data Warehouses for analytics.

Watch Online Modern Data Warehouses & Data Lakes

Join premium to watch
Go to premium
# Title Duration
1 Introduction 02:14
2 Data Science Platform 04:11
3 ETL & ELT Data Warehouse 06:23
4 Data Lake & Data Warehouse integration 03:30
5 GCP & AWS Piplines we build 03:15
6 GCP hands on Cloud Storage & BigQuery 08:36
7 GCP hands on create Data Studio dashboard 07:34
8 GCP Recap & AWS goals 02:13
9 AWS Setup & upload data to S3 02:13
10 Athena Data Lake manual table configuration 03:49
11 Creating a Quicksight dashboard 05:06
12 Athena configuration using AWS Glue data catalog 03:30
13 Course recap 02:37
14 BONUS Configure Redshift Spectrum table with S3 02:58

Similar courses to Modern Data Warehouses & Data Lakes

Introduction to Data Engineering 2025

Introduction to Data Engineering 2025Andreas Kretz

Category: Data processing and analysis
Duration 44 minutes 26 seconds
Apache Airflow Workflow Orchestration

Apache Airflow Workflow OrchestrationAndreas Kretz

Category: Other (Tools), Data processing and analysis
Duration 1 hour 18 minutes 41 seconds
Learning Apache Spark

Learning Apache SparkAndreas Kretz

Category: Data processing and analysis
Duration 1 hour 44 minutes 4 seconds
Mathematical Foundations of Machine Learning

Mathematical Foundations of Machine Learningudemy

Category: Python, Data processing and analysis
Duration 16 hours 25 minutes 26 seconds
TensorFlow Developer Certificate in 2023: Zero to Mastery

TensorFlow Developer Certificate in 2023: Zero to Masteryzerotomastery.io

Category: Data processing and analysis
Duration 62 hours 43 minutes 54 seconds
Machine Learning Design Questions

Machine Learning Design Questionsalgoexpert

Category: Data processing and analysis
Duration 3 hours 3 minutes 57 seconds
Data Engineering on GCP

Data Engineering on GCPAndreas Kretz

Category: Data processing and analysis
Duration 1 hour 17 minutes 33 seconds
2022 Python for Machine Learning & Data Science Masterclass

2022 Python for Machine Learning & Data Science Masterclassudemy

Category: Python, Data processing and analysis
Duration 44 hours 5 minutes 31 seconds
Statistics Bootcamp (with Python): Zero to Mastery

Statistics Bootcamp (with Python): Zero to Masteryzerotomastery.io

Category: Python, ChatGPT, Data processing and analysis
Duration 20 hours 50 minutes 51 seconds
Deep Learning: Advanced Computer Vision

Deep Learning: Advanced Computer Visionudemy

Category: Data processing and analysis
Duration 15 hours 10 minutes 54 seconds