A friend pinged me recently to ask about rolling back Azure Data Factory (ADF) pipeline versions. My response was a question: Are you using source control with ADF? That did not help the current situation. I thought of the way I often build ADF pipelines and shared my methodology, which is relatively simple (it has …
Continue reading One Way to Incrementally Develop ADF Pipelines
Category:Summer.ADF.2020
Nesting ForEach Activities in Azure Data Factory
Near the end of June 2020, I delivered a free Enterprise Data & Analytics Summer o’ ADF webinar titled Using the Azure Data Factory ForEach Activity. My friend Meagan Longoria (Blog | @MMarie | LinkedIn) was in attendance. If you don’t know Meagan, you should – especially if you work with analytics. She’s scary-smart about …
Continue reading Nesting ForEach Activities in Azure Data Factory
The Recording for Building an SSIS Framework in Azure Data Factory
Enjoy this recording of the (free!) Enterprise Data & Analytics webinar titled Building an SSIS Framework in ADF! :{> Need Help Getting Started with ADF? Enterprise Data & Analytics specializes in helping enterprises modernize their data engineering by lifting and shifting SSIS from on-premises to the cloud. Our experienced engineers grok enterprises of all sizes. We’ve done the hard work …
Continue reading The Recording for Building an SSIS Framework in Azure Data Factory
Free Webinar – Building an SSIS Framework in ADF
Join me at 12:00 PM EDT on 9 Jul 2020 for Building an SSIS Framework in ADF, another free Summer o’ ADF webinar from Enterprise Data & Analytics. Abstract Andy authors SSIS frameworks according to a few principles: 1. Functionality 2. Empathy 3. Simplicity Join Microsoft Data Platform MVP Andy Leonard as he discusses and …
Continue reading Free Webinar – Building an SSIS Framework in ADF
Free Webinar: Using the Azure Data Factory ForEach Activity
The Azure Data Factory ForEach activity iterates collections. This makes the ForEach activity extremely useful for acting on flexible number of items. As with all software, there are corners. So, I cover a gotcha or two in this free webinar from Enterprise Data & Analytics at 12:00 PM EDT 30 Jun 2020. Register today for …
Continue reading Free Webinar: Using the Azure Data Factory ForEach Activity
The Recording of Configuring and Managing ADF Azure-SSIS Integration Runtimes is Available
Enjoy this recording of Configuring and Managing ADF Azure-SSIS Integration Runtimes! <ShamelessPlug> Need Help Getting Started with ADF? Enterprise Data & Analytics specializes in helping enterprises modernize their data engineering by lifting and shifting SSIS from on-premises to the cloud. Our experienced engineers grok enterprises of all sizes. We’ve done the hard work for large and challenging data engineering enterprises. …
Continue reading The Recording of Configuring and Managing ADF Azure-SSIS Integration Runtimes is Available
One Way to Break Out of an Azure Data Factory ForEach Activity
First, a couple shoutouts to my brothers and friends, Joel Cochran (@joelcochran) and Shannon Lowder (@shannonlowder). This approach grew out of conversations with them. The ForEach activity iterates over a collection of items. One less-documented property of the ForEach activity is it (currently) iterates the entire collection. I can hear some of you asking… “What …
Continue reading One Way to Break Out of an Azure Data Factory ForEach Activity
Configure Azure Data Factory Security for the ADF REST API
Before using the Azure Data Factory’s REST API in a Web activity’s Settings tab, security must be configured. Azure Data Factory pipelines may use the Web activity to call ADF REST API methods if and only if the Azure Data Factory managed identity is assigned the Contributor role. More information about the problem I am …
Continue reading Configure Azure Data Factory Security for the ADF REST API
The Summer o’ ADF, v2020
I am pleased to announce the Summer o’ ADF, v2020, is on! Webinars: [Recording] Updates to the SSIS Framework Posts: [Recoding] Building an SSIS Framework in Azure Data Factory One Way to Incrementally Develop ADF Pipelines Nesting ForEach Activities in Azure Data Factory [Recording] Using the Azure Data Factory ForEach Activity [Recording] Configuring and Managing ADF …
Continue reading The Summer o’ ADF, v2020
Azure Data Factory Supports Excel Files
Excel format in Azure Data Factory. A welcome addition to ADF! When adding an ADF DataSet: I am convinced they got tired of me saying, “Well, you’ll need SSIS if you want to read Excel…” Probably not, though. Either way… score! :{> Need Help Migrating to Azure? Enterprise Data & Analytics specializes in helping enterprises modernize their data …
Continue reading Azure Data Factory Supports Excel Files