Learn Together: Ingest data with Spark and Microsoft Fabric notebooks

Full series information: https://aka.ms/learnlive-microsoft-fa...

More info here: https://aka.ms/learnlive-microsoft-fa...

Follow on Microsoft Learn:

- Complete the Learn module: https://aka.ms/learnlive-20240207A

Discover how to use Apache Spark and Python for data ingestion into a Microsoft Fabric lakehouse. Fabric notebooks provide a scalable and systematic solution.

---------------------

Learning objectives

- Ingest external data to Fabric lakehouses using Spark
- Configure external source authentication and optimization
- Load data into lakehouse as files or as Delta tables

---------------------

Chapters
--------
00:00 - Introduction
05:49 - Learning objectives
06:22 - Context in Fabric
10:32 - What is Spark?
14:55 - An introduction to notebooks
16:43 - Explore Fabric notebooks
22:29 - What is a lakehouse?
25:45 - Fabric lakehouse vs Data warehouse
28:48 - Write data into a lakehouse
30:58 - Write to a Delta table
34:14 - Consider uses for ingested data
42:02 - Exercise - Ingest data with Spark and Microsoft Fabric notebooks
1:04:52 - Knowledge check
1:13:25 - Summary

---------------------

Presenters

Johan Ludvig Brattås
Director, Microsoft MVP
Deloitte
- LinkedIn: LinkedIn: johanludvig

Heini Ilmarinen
Azure Lead, Microsoft MVP
Polar Squad
- Twitter: Twitter: HeiniIlmarinen
- LinkedIn: LinkedIn: heini-ilmarinen

Moderators

Marcel Magalhães
Power BI Consultant, Microsoft Super User
G2M Consultoria e Treinamento
- LinkedIn: LinkedIn: marcelsmagalhaes


Olivier Van Steenlandt
Core Member, Microsoft MVP
dataMinds.be
- LinkedIn: LinkedIn: oliviervansteenlandt

• #science_technology
• #microsoft_learn_live
• #fabric
• #data_analyst
• #data_engineer
• #data_scientist
• #intermediate