Data Engineering Execution Orchestration Frameworks in Fabric Data Factory Series Landing Page

The Data Engineering Execution Orchestration Frameworks in Fabric Data Factory series includes the following posts: Tinkering with Fabric Data Factory Framework Functionality – 13 Feb 2024 One Way to Invoke Fabric Data Factory Pipelines Using the Fabric REST API – 30 May 2024 Use Azure Data Factory in Fabric Data Factory – 2 Oct 2024 …
Continue reading Data Engineering Execution Orchestration Frameworks in Fabric Data Factory Series Landing Page

Fabric Data Factory Design Pattern – Dynamically Start a Collection of Child Pipelines

In the first post in this series – a post titled Fabric Data Factory Design Pattern – Basic Parent-Child – I demonstrated one way to build a basic parent-child design pattern in Fabric Data Factory by calling one pipeline (child) from another pipeline (parent). In the second post, titled Fabric Data Factory Design Pattern – …
Continue reading Fabric Data Factory Design Pattern – Dynamically Start a Collection of Child Pipelines

Fabric Data Factory Design Pattern – Dynamically Start a Child Pipeline

In an earlier post titled Fabric Data Factory Design Pattern – Basic Parent-Child, I demonstrated one way to build a basic parent-child design pattern in Fabric Data Factory by calling one pipeline (child) from another pipeline (parent). In a later earlier post titled Fabric Data Factory Design Pattern – Parent-Child with Parameters, I modified the parent …
Continue reading Fabric Data Factory Design Pattern – Dynamically Start a Child Pipeline

Fabric Data Factory Design Pattern – Parent-Child with Parameters

In an earlier post, I demonstrated one way to build a basic parent-child design pattern in Fabric Data Factory by calling one pipeline (child) from another (parent). In this post, I modify the parent and child pipelines to demonstrate calling a child pipeline that contains a parameter. In this post, we will: Clone and edit …
Continue reading Fabric Data Factory Design Pattern – Parent-Child with Parameters

Fabric Data Factory Design Pattern – Basic Parent-Child

The Microsoft Fabric Team released a new Invoke Pipeline Activity in September 2024. This post describes one way to implement a parent-child design pattern using the new activity. In this post, we will: Create a new workspace Build a child pipeline Build a parent pipeline Test Create a New Workspace Connect to Fabric Data Factory. …
Continue reading Fabric Data Factory Design Pattern – Basic Parent-Child

Use Azure Data Factory in Fabric Data Factory

Thanks to the hard work of the Microsoft Fabric Data Factory Team, it’s now possible to mount an Azure Data Factory in Fabric Data Factory. This post describes one way to mount an existing Azure Data Factory in Fabric Data Factory. In this post, we will: Mount an existing Azure Data Factory in Fabric Data …
Continue reading Use Azure Data Factory in Fabric Data Factory

SSIS Extension Updates – Sep 2024

Back in Jun 2024, I announced I was changing the way I report updates to the SQL Server Integration Services extension for Visual Studio (in a post titled SSIS Extension Updates – Jun 2024). Right on time, here’s the second quarterly update. There Are Two Integration Services Extensions I’m not sure why the decision was …
Continue reading SSIS Extension Updates – Sep 2024

Announcing SSIS Catalog Browser v0.9.20

Kent Bradshaw and I are excited to announce the availability of SSIS Catalog Browser v0.9.20! SSIS Catalog Browser is free and surfaces SSIS Catalog projects and configurations metadata in a single unified view. The latest version fixed a handful of bugs, improved load query efficiency, and fixed duplication and misplacement of reference mappings in project and …
Continue reading Announcing SSIS Catalog Browser v0.9.20

Potential Danger Using Deploy Package with SSIS 2016

I… tweeted? X’d?… this message 11 Jul 2024. As promised, here’s the public post. If you want to skip some history mixed with the description of EDNA’s SSIS framework, feel free to go to the section labeled “Imagine My Surprise…” Some Back Story I have a long and storied history with frameworks. My ETL frameworks …
Continue reading Potential Danger Using Deploy Package with SSIS 2016