Please find the landing page for this series here. In an earlier post in this series – a post titled Fabric Data Factory Design Pattern – Basic Parent-Child – I demonstrated one way to build a basic parent-child design pattern in Fabric Data Factory by calling one pipeline (child) from another pipeline (parent). In the …
Continue reading Fabric Data Factory Design Pattern – Execute a Collection of Child Pipelines from Metadata
Tag:fabric
Data Engineering Execution Orchestration Frameworks in Fabric Data Factory Series Landing Page
The Data Engineering Execution Orchestration Frameworks in Fabric Data Factory series includes the following posts: Tinkering with Fabric Data Factory Framework Functionality – 13 Feb 2024 One Way to Invoke Fabric Data Factory Pipelines Using the Fabric REST API – 30 May 2024 Use Azure Data Factory in Fabric Data Factory – 2 Oct 2024 …
Continue reading Data Engineering Execution Orchestration Frameworks in Fabric Data Factory Series Landing Page
Fabric Data Factory Design Pattern – Dynamically Start a Child Pipeline
In an earlier post titled Fabric Data Factory Design Pattern – Basic Parent-Child, I demonstrated one way to build a basic parent-child design pattern in Fabric Data Factory by calling one pipeline (child) from another pipeline (parent). In a later earlier post titled Fabric Data Factory Design Pattern – Parent-Child with Parameters, I modified the parent …
Continue reading Fabric Data Factory Design Pattern – Dynamically Start a Child Pipeline
Fabric Data Factory Design Pattern – Parent-Child with Parameters
In an earlier post, I demonstrated one way to build a basic parent-child design pattern in Fabric Data Factory by calling one pipeline (child) from another (parent). In this post, I modify the parent and child pipelines to demonstrate calling a child pipeline that contains a parameter. In this post, we will: Clone and edit …
Continue reading Fabric Data Factory Design Pattern – Parent-Child with Parameters
Fabric Data Factory Design Pattern – Basic Parent-Child
The Microsoft Fabric Team released a new Invoke Pipeline Activity in September 2024. This post describes one way to implement a parent-child design pattern using the new activity. In this post, we will: Create a new workspace Build a child pipeline Build a parent pipeline Test Create a New Workspace Connect to Fabric Data Factory. …
Continue reading Fabric Data Factory Design Pattern – Basic Parent-Child
Presenting A Day of Fabric Data Factory at SQL Saturday Pittsburgh
I’m honored to announce I am delivering A Day of Fabric Data Factory – a full-day of in-person pre-conference training at SQL Saturday Pittsburgh! The precon happens Friday, 11 Oct 2024; SQL Saturday Pittsburgh is Saturday, 12 Oct 2024. Abstract Do you want to learn more about cloud data integration using Fabric Data Factory? Is …
Continue reading Presenting A Day of Fabric Data Factory at SQL Saturday Pittsburgh
One Way to Invoke Fabric Data Factory Pipelines Using the Fabric REST API
I’m an automation weenie, that’s a fact. It’s why I’m drawn to frameworks – especially data engineering execution orchestration frameworks. Speaking of frameworks, if you haven’t checked out Martin Schoombee’s series titled Building a Framework for Orchestration in Azure Data Factory: A Series, you are missing out. First, Martin is scary smart. Second, he shares practical …
Continue reading One Way to Invoke Fabric Data Factory Pipelines Using the Fabric REST API
Announcing Data Engineering Fridays!
I’m excited to announce Data Engineering Fridays! I can hear some of you thinking, … “What are Data Engineering Fridays, Andy?” That’s an awesome question! I’m glad you asked. Data Engineering Fridays is a weekly stream, between 24 May and 23 Aug 2024, in which I lead a discussion about data engineering-related topics. The 24 …
Continue reading Announcing Data Engineering Fridays!
Join me for A Day of Fabric Data Factory 24 Jun 2024!
Join me 9:00 AM-4:30 PM EDT 24 Jun 2024 for a full day of live and online training! Register today for A Day of Fabric Data Factory and save! Discount ends soon. Course Description Do you want to learn more about cloud data integration using Fabric Data Factory? Is your enterprise planning to migrate its …
Continue reading Join me for A Day of Fabric Data Factory 24 Jun 2024!
Why is There an Image on Empty Fabric Synapse Data Engineering Screens?
I’m not sure why there’s an image on empty Microsoft Fabric Synapse Data Engineering screens, but I have a theory. My theory makes sense if you compare a Fabric Synapse Data Engineering screen with the image and verbiage, “There’s nothing here yet Add something new, or upload something to see them here.” with the Fabric …
Continue reading Why is There an Image on Empty Fabric Synapse Data Engineering Screens?