Modern Data Warehouses & Data Lakes
58m 9s
English
Paid
Course description
As a data engineer, you will regularly work with analytical platforms where companies store data in Data Lakes and Data Warehouses for building visualizations and creating machine learning models.
Modern data warehouses, such as AWS Redshift, Google BigQuery, and Snowflake, allow you to load data directly from files in a Data Lake. This integration makes working with warehouses flexible and convenient for analytical tasks.
Read more about the course
In this course you will learn:
- How to use Data Lakes, Data Warehouses, and BI tools in a unified system
- How to load data into Data Lakes and visualize it in reports
- How to build integrations in Google Cloud Platform and AWS
- How ETL/ELT architecture works and how to apply it in modern data warehouses
Basics of Data Warehouses and Data Lakes
- The role of data warehouses in analytical platforms
- How data is loaded into Data Warehouse through ETL/ELT
- What Data Lakes are and how to use them
- How to work with files directly in the data lake
Practice on GCP: Cloud Storage, BigQuery, and Data Studio
- Setting up Cloud Storage, creating a table in BigQuery
- Data visualization in Data Studio
- Understanding the general principles of cloud platforms
Practice on AWS: S3, Athena, Glue, and Quicksight
- Creating data integration through S3, Athena, and Quicksight
- Setting up Glue Data Catalog for data management
- Detailed setup and integration of Glue
Summary and bonus lesson: AWS Redshift Spectrum
- Course summary
- Additional module on working with Redshift Spectrum using the prepared Data Catalog from the AWS project
Required knowledge
- Basics of working with Data Warehouses (it is recommended to take the "Data Warehouses" course in the academy)
- Basic knowledge of AWS Athena and Redshift (for the block with Redshift Spectrum, a prepared Data Catalog from the AWS project is used)
This course will help you master modern approaches to building data storage and processing systems and learn how to effectively use the capabilities of Data Lakes and Data Warehouses for analytics.
Watch Online
Watch Online Modern Data Warehouses & Data Lakes
0:00
/ #1: Introduction
All Course Lessons (14)
| # | Lesson Title | Duration | Access |
|---|---|---|---|
| 1 | Introduction Demo | 02:14 | |
| 2 | Data Science Platform | 04:11 | |
| 3 | ETL & ELT Data Warehouse | 06:23 | |
| 4 | Data Lake & Data Warehouse integration | 03:30 | |
| 5 | GCP & AWS Piplines we build | 03:15 | |
| 6 | GCP hands on Cloud Storage & BigQuery | 08:36 | |
| 7 | GCP hands on create Data Studio dashboard | 07:34 | |
| 8 | GCP Recap & AWS goals | 02:13 | |
| 9 | AWS Setup & upload data to S3 | 02:13 | |
| 10 | Athena Data Lake manual table configuration | 03:49 | |
| 11 | Creating a Quicksight dashboard | 05:06 | |
| 12 | Athena configuration using AWS Glue data catalog | 03:30 | |
| 13 | Course recap | 02:37 | |
| 14 | BONUS Configure Redshift Spectrum table with S3 | 02:58 |
Unlock unlimited learning
Get instant access to all 13 lessons in this course, plus thousands of other premium courses. One subscription, unlimited knowledge.
Learn more about subscriptionComments
0 commentsWant to join the conversation?
Sign in to commentSimilar courses
Case Study in Causal Analysis
Sources: LunarTech
This course offers unique opportunities for students striving to master methods of causal analysis. This course is designed to inspire...
2 hours 3 minutes 34 seconds
TensorFlow Developer Certificate in 2023: Zero to Mastery
Sources: zerotomastery.io
Learn TensorFlow. Pass the TensorFlow Developer Certificate Exam. Get Hired as a TensorFlow developer. This course will take you from a TensorFlow beginner to b
62 hours 43 minutes 54 seconds
Getting Started with Embedded AI | Edge AI
Sources: udemy
Nowadays, you may have heard of many keywords like Embedded AI /Embedded ML /Edge AI, the meaning behind them is the same, I.e. To make an AI algorithm or model
3 hours 33 minutes 42 seconds
Data Engineering on Databricks
Sources: Andreas Kretz
Databricks is one of the most popular platforms for data processing using Apache Spark and creating modern data warehouses (Lakehouse).
1 hour 27 minutes 29 seconds
Data Platform & Pipeline Design
Sources: Andreas Kretz
Data pipelines are a key component of any Data Science platform. Without them, data loading and machine learning model deployment would not be possible. This...
1 hour 59 minutes 5 seconds