Databricks Delta Lake Data Integration Demo (Auto Loader and COPY INTO)

Visit https://databricks.com/discover/demos to view more demos, download notebooks, and sign up for the free Databricks Community Edition.

With Databricks Auto Loader, you can incrementally and efficiently ingest new batch and real-time streaming data files into your Delta Lake tables as soon as they arrive in your data lake — so that they always contain the most complete and up-to-date data available. Auto Loader is a simple, flexible tool that can be run continuously, or in “triggerOnce” mode to process data in batches. SQL users can use the simple “COPY INTO’' command to pull new data into their Delta Lake tables automatically, without the need to keep track of which files have already been processed.

Read more here: https://databricks.com/discover/demos...

Video chapters:
0:00 Getting data into Delta Lake with Auto Loader
0:28 How to use Databricks Auto Loader
1:09 Using Auto Loader in batch mode with triggerOnce
1:37 Loading data with COPY INTO for SQL users

Connect with us:
Website: https://databricks.com​
Facebook: Facebook: databricksinc​
Twitter: Twitter: databricks​
LinkedIn: LinkedIn: databricks
Instagram: Instagram: ​ Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. https://databricks.com/databricks-nam...

• #science_technology
• #databricks
• #delta_lake
• #integration
• #demo
• #auto_loader
• #copy_into