Azure Data LakeHouse in an Hour Virtual Workshop

In the Spirit of popular "Dashboard in a Day" workshops, this virtual workshop walks you through both the basic concepts and a hands-on build of an Azure Data LakeHouse using public CDC National Notifiable Diseases Surveillance System (NNDSS) data. If you don't write code, fear not! There is minimal code in this workshop and a link to a document where you can cut & paste a few snippets of code is included below. You can follow along with the video to build out your own Azure Data LakeHouse using Azure Data Lake and Azure Data Factory. Hopefully after watching this video you'll gain a basic understanding of the LakeHouse architecture, reasons it is valuable, and how it can be applied. If you follow along and build your own Data LakeHouse, you'll also have a functional Azure Data LakeHouse with weekly updates of CDC NNDSS data.

Document with "Cut and Paste" Code Snippets - https://github.com/gregbeaumont/Power...

CHAPTERS
0:00 Intro (Get an Azure Account link: https://azure.microsoft.com/en-us/free/ )
3:06 Overview of CDC National Notifiable Diseases Surveillance System (NNDSS) data (https://www.cdc.gov/nndss/index.html )
4:04 Overview of Azure Data LakeHouse Architecture
6:34 Step One - Create Resource Group, Azure Data Lake, and Azure Data Factory
8:50 Step Two - Rapid Prototype of the Data Model
12:43 Step Three - Define the Datasets in Azure Data Factory
23:21 Step Four - Populate the Bronze Layer of the Azure Data LakeHouse
26:12 Step Five - Populate the Silver Layer of the Azure Data LakeHouse
42:31 Step Six - Populate the Gold Layer of the Azure Data LakeHouse
50:53 Step Seven - Automate the Weekly Update and Store Historical Snapshots
1:03:53 Cost Review
1:04:40 Outro

• #science_technology
• #data_lakehouse
• #azure
• #microsoft
• #azure_data_factory
• #azure_data_lake
• #cdc_data
• #cdc_nndss
• #national_notifiable_diseases_surveillance_system