Introducing Managed Airflow in Azure Data Factory

Azure Data Factory (ADF) is a fully managed cloud service built for petabyte-scale data ingestion, transformation, and orchestration at scale. Azure Data Factory provides data engineers with a familiar and productive environment for authoring their data integration pipelines and data flows for large-scale code-free transformations. Users have sophisticated data pipelines and data transformation capabilities to author robust data integration tasks that operate over large amounts of data. Hundreds of connectors enable data-source-specific connectivity to ingest data from diverse data sources (e.g., multi-cloud, SaaS, on-premises), transform data at scale, and more.

Azure Data Factory Managed Airflow provides a managed orchestration service for Apache Airflow that simplifies the creation and management of Airflow environments. In addition, it natively integrates Apache Airflow with Azure Active Directory for a single sign-on and a more secure solution (instead of requiring basic auth for logins).  

Speaker:

Abhishek Narain is a Principal Program Manager in the Data Integration group @Microsoft, leading the product efforts on Azure Data Factory – a hybrid, cloud-scale ETL service on Azure.

[eventID:18529]