A friend pinged me recently to ask about rolling back Azure Data Factory (ADF) pipeline versions. My response was a question: Are you using source control with ADF? That did not help the current situation. I thought of the way I often build ADF pipelines and shared my methodology, which is relatively simple (it has …
Continue reading One Way to Incrementally Develop ADF Pipelines
Category:ADF
Nesting ForEach Activities in Azure Data Factory
Near the end of June 2020, I delivered a free Enterprise Data & Analytics Summer o’ ADF webinar titled Using the Azure Data Factory ForEach Activity. My friend Meagan Longoria (Blog | @MMarie | LinkedIn) was in attendance. If you don’t know Meagan, you should – especially if you work with analytics. She’s scary-smart about …
Continue reading Nesting ForEach Activities in Azure Data Factory
The Recording for Building an SSIS Framework in Azure Data Factory
Enjoy this recording of the (free!) Enterprise Data & Analytics webinar titled Building an SSIS Framework in ADF! :{> Need Help Getting Started with ADF? Enterprise Data & Analytics specializes in helping enterprises modernize their data engineering by lifting and shifting SSIS from on-premises to the cloud. Our experienced engineers grok enterprises of all sizes. We’ve done the hard work …
Continue reading The Recording for Building an SSIS Framework in Azure Data Factory
Learn SSIS Data Flows and Azure Data Factory in August 2020!
I recently added two online training deliveries for August 2020: 10-11 Aug 2020: SSIS Data Flows 12 Aug 2020: Master the Fundamentals of Azure Data Factory SSIS Data Flows is a two-day, online, live course designed to jumpstart SSIS developers who want to learn SSIS and those who desire to fill gaps in their self-taught …
Continue reading Learn SSIS Data Flows and Azure Data Factory in August 2020!
SQL Server Data Automation through Frameworks Book Available for Pre-Order
Although the cover image needs an update, my and Kent Bradshaw’s next book – titled “SQL Server Data Automation through Frameworks: Building Metadata-driven Frameworks with T-SQL, SSIS, and Azure Data Factory” is available for pre-order!
Free Webinar – Building an SSIS Framework in ADF
Join me at 12:00 PM EDT on 9 Jul 2020 for Building an SSIS Framework in ADF, another free Summer o’ ADF webinar from Enterprise Data & Analytics. Abstract Andy authors SSIS frameworks according to a few principles: 1. Functionality 2. Empathy 3. Simplicity Join Microsoft Data Platform MVP Andy Leonard as he discusses and …
Continue reading Free Webinar – Building an SSIS Framework in ADF
Recording – Using the Azure Data Factory ForEach Activity
In this video, Andy Leonard discusses and demonstrates the Azure Data Factory ForEach activity.
Four Questions to Ask When Hiring an Enterprise Data Consultant
It’s time to hire a consultant for your enterprise data project. That is awesome news, but a quick search for the perfect consultancy reveals a number of options (and hourly rates). What’s a CEO, CIO, CFO, VP, or Director to do? How do you choose a consultant with the right experience for your enterprise data …
Continue reading Four Questions to Ask When Hiring an Enterprise Data Consultant
One Way to Break Out of an Azure Data Factory ForEach Activity
First, a couple shoutouts to my brothers and friends, Joel Cochran (@joelcochran) and Shannon Lowder (@shannonlowder). This approach grew out of conversations with them. The ForEach activity iterates over a collection of items. One less-documented property of the ForEach activity is it (currently) iterates the entire collection. I can hear some of you asking… “What …
Continue reading One Way to Break Out of an Azure Data Factory ForEach Activity
Configure Azure Data Factory Security for the ADF REST API
Before using the Azure Data Factory’s REST API in a Web activity’s Settings tab, security must be configured. Azure Data Factory pipelines may use the Web activity to call ADF REST API methods if and only if the Azure Data Factory managed identity is assigned the Contributor role. More information about the problem I am …
Continue reading Configure Azure Data Factory Security for the ADF REST API