Presenting Master the Fundamentals of ADF at SQL Saturday Boston!

I am honored to deliver Master the Fundamentals of ADF at SQL Saturday Boston 2022 (#1031) 7 Oct 2022! Abstract Azure Data Factory, or ADF, is an Azure PaaS (Platform-as-a-Service) that provides hybrid data integration at global scale. Use ADF to build fully managed ETL in the cloud – including SSIS. Join Andy Leonard – …
Continue reading Presenting Master the Fundamentals of ADF at SQL Saturday Boston!

An ADF Azure-SSIS Framework

I spent a little time walking through the third section of the book SQL Server Data Automation Through Frameworks: Building Metadata-Driven Frameworks with T-SQL, SSIS, and Azure Data Factory co-authored by (the) Kent Bradshaw and me. At the start of Part 1, I included thoughts about our first review. Part 1 did not go as planned. …
Continue reading An ADF Azure-SSIS Framework

The Recording for Building an SSIS Framework in Azure Data Factory

Enjoy this recording of the (free!) Enterprise Data & Analytics webinar titled Building an SSIS Framework in ADF! :{> Need Help Getting Started with ADF? Enterprise Data & Analytics specializes in helping enterprises modernize their data engineering by lifting and shifting SSIS from on-premises to the cloud. Our experienced engineers grok enterprises of all sizes. We’ve done the hard work …
Continue reading The Recording for Building an SSIS Framework in Azure Data Factory

Free Webinar – Building an SSIS Framework in ADF

Join me at 12:00 PM EDT on 9 Jul 2020 for Building an SSIS Framework in ADF, another free Summer o’ ADF webinar from Enterprise Data & Analytics. Abstract Andy authors SSIS frameworks according to a few principles: 1. Functionality 2. Empathy 3. Simplicity Join Microsoft Data Platform MVP Andy Leonard as he discusses and …
Continue reading Free Webinar – Building an SSIS Framework in ADF

One Way to Break Out of an Azure Data Factory ForEach Activity

First, a couple shoutouts to my brothers and friends, Joel Cochran (@joelcochran) and Shannon Lowder (@shannonlowder). This approach grew out of conversations with them. The ForEach activity iterates over a collection of items. One less-documented property of the ForEach activity is it (currently) iterates the entire collection. I can hear some of you asking… “What …
Continue reading One Way to Break Out of an Azure Data Factory ForEach Activity

Configure Azure Data Factory Security for the ADF REST API

Before using the Azure Data Factory’s REST API in a Web activity’s Settings tab, security must be configured. Azure Data Factory pipelines may use the Web activity to call ADF REST API methods if and only if the Azure Data Factory managed identity is assigned the Contributor role. More information about the problem I am …
Continue reading Configure Azure Data Factory Security for the ADF REST API

An Introduction to Azure Data Factory REST API

TL;DR: To read the value portion of a key-value pair stored in JSON in an ADF pipeline, interrogate properties.<key>, where key is the key-part of the key-value JSON pair. Introduction Last month I wrote a post titled Stop an Azure-SSIS Files Integration Runtime (Safely). The post generated a bunch of hits, which is awesome. The …
Continue reading An Introduction to Azure Data Factory REST API