I’m an automation weenie, that’s a fact. It’s why I’m drawn to frameworks – especially data engineering execution orchestration frameworks. Speaking of frameworks, if you haven’t checked out Martin Schoombee’s series titled Building a Framework for Orchestration in Azure Data Factory: A Series, you are missing out. First, Martin is scary smart. Second, he shares practical …
Continue reading One Way to Invoke Fabric Data Factory Pipelines Using the Fabric REST API
Category:Pipeline
Scaffold Design Pattern in Fabric Data Factory Pipeline
When assigned a project, it’s tempting – and dangerous – to Just Start Coding. If you suffer from the urge to develop first and design later, you are not alone (there’s at least one other developer like you and he’s typing this post). Do yourself a favor and… Design First As the definition of “design” …
Continue reading Scaffold Design Pattern in Fabric Data Factory Pipeline
Scheduling and Monitoring a Fabric Data Factory Pipeline Execution
The more I work with Microsoft Fabric Data Factory, the more I like it. In this post, I share one way to schedule a Microsoft Fabric Data Factory pipeline, a different way to test execute a pipeline, and then one way to monitor the execution. Schedule a Pipeline Connect to Microsoft Fabric Data Factory and …
Continue reading Scheduling and Monitoring a Fabric Data Factory Pipeline Execution