First, a couple shoutouts to my brothers and friends, Joel Cochran (@joelcochran) and Shannon Lowder (@shannonlowder). This approach grew out of conversations with them. The ForEach activity iterates over a collection of items. One less-documented property of the ForEach activity is it (currently) iterates the entire collection. I can hear some of you asking… “What …
Continue reading One Way to Break Out of an Azure Data Factory ForEach Activity
Category:REST API
Configure Azure Data Factory Security for the ADF REST API
Before using the Azure Data Factory’s REST API in a Web activity’s Settings tab, security must be configured. Azure Data Factory pipelines may use the Web activity to call ADF REST API methods if and only if the Azure Data Factory managed identity is assigned the Contributor role. More information about the problem I am …
Continue reading Configure Azure Data Factory Security for the ADF REST API
An Introduction to Azure Data Factory REST API
TL;DR: To read the value portion of a key-value pair stored in JSON in an ADF pipeline, interrogate properties.<key>, where key is the key-part of the key-value JSON pair. Introduction Last month I wrote a post titled Stop an Azure-SSIS Files Integration Runtime (Safely). The post generated a bunch of hits, which is awesome. The …
Continue reading An Introduction to Azure Data Factory REST API