I am honored to deliver Master the Fundamentals of ADF at SQL Saturday Boston 2022 (#1031) 7 Oct 2022! Abstract Azure Data Factory, or ADF, is an Azure PaaS (Platform-as-a-Service) that provides hybrid data integration at global scale. Use ADF to build fully managed ETL in the cloud – including SSIS. Join Andy Leonard – …
Continue reading Presenting Master the Fundamentals of ADF at SQL Saturday Boston!
Category:REST API
An ADF Azure-SSIS Framework
I spent a little time walking through the third section of the book SQL Server Data Automation Through Frameworks: Building Metadata-Driven Frameworks with T-SQL, SSIS, and Azure Data Factory co-authored by (the) Kent Bradshaw and me. At the start of Part 1, I included thoughts about our first review. Part 1 did not go as planned. …
Continue reading An ADF Azure-SSIS Framework
The Recording for Building an SSIS Framework in Azure Data Factory
Enjoy this recording of the (free!) Enterprise Data & Analytics webinar titled Building an SSIS Framework in ADF! :{> Need Help Getting Started with ADF? Enterprise Data & Analytics specializes in helping enterprises modernize their data engineering by lifting and shifting SSIS from on-premises to the cloud. Our experienced engineers grok enterprises of all sizes. We’ve done the hard work …
Continue reading The Recording for Building an SSIS Framework in Azure Data Factory
Free Webinar – Building an SSIS Framework in ADF
Join me at 12:00 PM EDT on 9 Jul 2020 for Building an SSIS Framework in ADF, another free Summer o’ ADF webinar from Enterprise Data & Analytics. Abstract Andy authors SSIS frameworks according to a few principles: 1. Functionality 2. Empathy 3. Simplicity Join Microsoft Data Platform MVP Andy Leonard as he discusses and …
Continue reading Free Webinar – Building an SSIS Framework in ADF
Recording – Using the Azure Data Factory ForEach Activity
In this video, Andy Leonard discusses and demonstrates the Azure Data Factory ForEach activity.
One Way to Break Out of an Azure Data Factory ForEach Activity
First, a couple shoutouts to my brothers and friends, Joel Cochran (@joelcochran) and Shannon Lowder (@shannonlowder). This approach grew out of conversations with them. The ForEach activity iterates over a collection of items. One less-documented property of the ForEach activity is it (currently) iterates the entire collection. I can hear some of you asking… “What …
Continue reading One Way to Break Out of an Azure Data Factory ForEach Activity
Configure Azure Data Factory Security for the ADF REST API
Before using the Azure Data Factory’s REST API in a Web activity’s Settings tab, security must be configured. Azure Data Factory pipelines may use the Web activity to call ADF REST API methods if and only if the Azure Data Factory managed identity is assigned the Contributor role. More information about the problem I am …
Continue reading Configure Azure Data Factory Security for the ADF REST API
An Introduction to Azure Data Factory REST API
TL;DR: To read the value portion of a key-value pair stored in JSON in an ADF pipeline, interrogate properties.<key>, where key is the key-part of the key-value JSON pair. Introduction Last month I wrote a post titled Stop an Azure-SSIS Files Integration Runtime (Safely). The post generated a bunch of hits, which is awesome. The …
Continue reading An Introduction to Azure Data Factory REST API