Stream Azure Cosmos DB Change Feed With Databricks Delta Live Tables

-------------------Setup required-------------------
0:00  | Introduction & road map
0:53  | Application of change feed in Cosmos DB
1:35  | Live migration scenario, materialized views, stream processing
4:45  | Architecture of Demonstration
5:34  | Python application Overview and data ingestion in Cosmos DB
8:01  | Databricks notebook to begin streaming job, configuring checkpoint logic, creating your config parameters, reading OLTP & request unit considerations
10:32| Installing Cosmos DB spark connector in cluster
11:10| Secret scopes & keys applicational value
12:02| Creating Key Vaults resource & secret scopes
13:13| Creating Databricks backed secret scopes through Azure Portal
14:47| Finding and inserting your Azure Key Vaults Resource ID
15:45| Generating Databricks tokens, working with Databricks CLI using Bash in Azure, retrieving created scopes in your Databricks workspace & notebook overview

-------------------Working with delta live tables & pipelines in Databricks-------------------
20:20| Working with stream using delta live tables & pipelines
20:57| Pipeline settings, pipeline notebook, creating bronze/silver delta live tables & starting pipeline job
23:17| Querying delta live silver table in real time
23:50| Demonstrating how Cosmos DB change feed is read in Databricks through spark after changes occur in container
27:25| Viewings intermediate changes in your container through delta live tables
28:32|Change table properties of delta table & viewing the delta table history
29:49| Querying table changes in your delta table
31:02| Overview of what was covered & last remarks


------------------- Resources -------------------
- DB notebook: https://www.databricks.com/notebooks/...

- https://learn.microsoft.com/en-us/azu...

- https://learn.microsoft.com/en-us/azu...

- https://learn.microsoft.com/en-us/azu...

- https://docs.databricks.com/workflows....