Blog Post Note / Disclaimer / Apology: This is a long blog post. It makes up for the length by being complex. I considered ways to shorten it and to reduce its complexity. This is the best I could do. – Andy Visit the landing page for the Data Engineering Execution Orchestration Frameworks in Fabric Data …
Continue reading Metadata-Driven Fabric Data Factory Pipeline Orchestration From ADF
Three Links to Stay Current on Microsoft Fabric
I’ve been following Microsoft Build online this week, and I’m particularly excited to watch a couple people I admire deliver the Closing Session 22 May 2025 at 11:30 AM PT – Scott Hanselman and Mark Russinovich. If you are unable to attend Build in person, you can register to attend many sessions online – for free. …
Continue reading Three Links to Stay Current on Microsoft Fabric
Regarding Return Pipeline Value Data Type
On last week’s exciting and thrilling episode of Data Engineering Fridays, I was stymied for a bit. You can watch me struggle with my code here – the struggle lasted for a while. I eventually figured it out. As an aside: I absolutely love streaming live-coding! Believe it or not, failing is one of my favorite parts. …
Continue reading Regarding Return Pipeline Value Data Type
SSMS v21 and SSIS
Regular readers of this blog know I am a fan of Star Trek. In fact, my beautiful bride and I recently finished streaming Star Trek: Deep Space 9. It was the first time either of us had watched the series start-to-finish and we enjoyed the characters and story lines. It is well-written. We agreed Worf’s …
Continue reading SSMS v21 and SSIS
Fabric Data Factory Pipeline Execution From Azure Data Factory
Visit the landing page for the Data Engineering Execution Orchestration Frameworks in Fabric Data Factory Series to learn more. I must begin this post with a simple – perhaps profound – statement: Koen Verbeeck (LinkedIn | @Ko_Ver) is a talented data engineer. Here’s why I begin this post with such a statement. If you’ve been following my …
Continue reading Fabric Data Factory Pipeline Execution From Azure Data Factory
Tinkering with AnalyticsCreator
I’ve been interested in data engineering code generation and automation for years. I was recently treated to a demo of AnalyticsCreator, a product I had hitherto not heard of. I was impressed with the live demo delivered by an in-house engineer. The engineer connected to a source database, selected several tables for import, selected a …
Continue reading Tinkering with AnalyticsCreator
Configure Azure Security for the Fabric Data Factory REST API
Visit the landing page for the Data Engineering Execution Orchestration Frameworks in Fabric Data Factory Series to learn more. I must begin this post with a simple – perhaps profound – statement: Koen Verbeeck (LinkedIn | @Ko_Ver) is a talented data engineer. Here’s why I begin this post with such a statement. Koen’s Great Idea …
Continue reading Configure Azure Security for the Fabric Data Factory REST API
Presenting Data Engineering Fundamentals with Fabric Data Factory at PASS Data Community Summit 2025
Data Engineering Fundamentals with Fabric Data Factory – a Full-Day Pre-Conference Training Session 17 Nov 2025 I am honored to present Data Engineering Fundamentals with Fabric Data Factory at the PASS Data Community Summit 2025 17 Nov 2025 in Seattle! Abstract This one-day training introduces data engineering concepts for enterprise data warehousing using Microsoft Fabric …
Continue reading Presenting Data Engineering Fundamentals with Fabric Data Factory at PASS Data Community Summit 2025
SSIS Extension Updates – Dec 2024
Back in Jun 2024, I announced I was changing the way I report updates to the SQL Server Integration Services extension for Visual Studio (in a post titled SSIS Extension Updates – Jun 2024). Right on time, here’s the third quarterly update. There Are Two Integration Services Extensions I’m not sure why the decision was made …
Continue reading SSIS Extension Updates – Dec 2024
Fabric Data Factory Design Pattern – Execute a Collection of Child Pipelines from Metadata
Visit the landing page for the Data Engineering Execution Orchestration Frameworks in Fabric Data Factory Series to learn more. In an earlier post in this series – a post titled Fabric Data Factory Design Pattern – Basic Parent-Child – I demonstrated one way to build a basic parent-child design pattern in Fabric Data Factory by calling one …
Continue reading Fabric Data Factory Design Pattern – Execute a Collection of Child Pipelines from Metadata