Data Engineering Execution Orchestration Frameworks in Fabric Data Factory Series Landing Page

The Data Engineering Execution Orchestration Frameworks in Fabric Data Factory series includes the following posts:

Tinkering with Fabric Data Factory Framework Functionality – 13 Feb 2024

One Way to Invoke Fabric Data Factory Pipelines Using the Fabric REST API – 30 May 2024

Use Azure Data Factory in Fabric Data Factory – 2 Oct 2024

Fabric Data Factory Design Pattern – Basic Parent-Child – 7 Oct 2024

Fabric Data Factory Design Pattern – Parent-Child with Parameters – 11 Oct 2024

Fabric Data Factory Design Pattern – Dynamically Start a Child Pipeline – 19 Oct 2024

Fabric Data Factory Design Pattern – Dynamically Start a Collection of Child Pipelines – 23 Oct 2024

Fabric Data Factory Design Pattern – Dynamically Start a Collection of Child Pipelines from Metadata – 8 Nov 2024

The Story

Way back in February 2024, I started tinkering with the notion of building an execution orchestration framework for Fabric Data Factory. I did a livestream and posted the video in the post titled Tinkering with Fabric Data Factory Framework Functionality.

In May 2024, I delved into the Fabric Data Factory REST API, documenting my findings in the post titled One Way to Invoke Fabric Data Factory Pipelines Using the Fabric REST API.

Beginning in late 2024, I put more time and attention on the topic and produced additional posts:

  1. Use Azure Data Factory in Fabric Data Factory
  2. Fabric Data Factory Design Pattern – Basic Parent-Child
  3. Fabric Data Factory Design Pattern – Parent-Child with Parameters
  4. Fabric Data Factory Design Pattern – Dynamically Start a Child Pipeline
  5. Fabric Data Factory Design Pattern – Dynamically Start a Collection of Child Pipelines
  6. Fabric Data Factory Design Pattern – Dynamically Start a Collection of Child Pipelines from Metadata

Conclusion

I plan to update this page as I publish more posts in this series.

Need Help?

Consulting

Enterprise Data & Analytics delivers data engineering consulting and data engineering code reviews!. Let our experienced teams lead your enterprise data integration implementation. Contact us today!

Training

We deliver Fabric Data Factory training live and online. Subscribe to Premium Level to access all my recorded training – which includes recordings of previous Fabric Data Factory trainings – for a full year.


We deliver data.

:{>

Andy Leonard

andyleonard.blog

Christian, husband, dad, grandpa, Data Philosopher, Data Engineer, Azure Data Factory, SSIS guy, and farmer. I was cloud before cloud was cool. :{>

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.