The more I work with Microsoft Fabric Data Factory, the more I like it.

In this post, I share one way to schedule a Microsoft Fabric Data Factory pipeline, a different way to test execute a pipeline, and then one way to monitor the execution.

Schedule a Pipeline

Connect to Microsoft Fabric Data Factory and open a pipeline. When the pipeline opens, click the Schedule button on the menu:

The data pipeline blade displays the Schedule blade (1).

I configured the following schedule properties / values:

2. Scheduled run: On
3. Repeat: Daily
4. Time: 06:01 AM
5. Start data and time: 03/01/2024
6. End date and time: 03/01/2034
7. Click the Apply button:

Note: the Apply button is disabled unless all properties are configured. This surprised me with the End date and time property. I expected I would be allowed to leave this property unconfigured and that this state would represent “run forever” or “Run until I set the Scheduled run property (2) to “Off.”

A Different Way to Execute a Pipeline

If I click the Run button on the blade pictured in the preceding image…

…the “Run succeeded” message displays immediately:

Monitoring a Pipeline Execution

Microsoft Fabric Data Factory includes a “Monitoring hub” (1) which surfaces sortable execution log data, for example:

2. Activity name: the name of the executed pipeline in this case
3. Status: may be Succeeded, Failed, Not started, In progress, etc.
4. Start time: the time and date the execution operation started:

To view pipeline execution details:

1. Click the ellipsis on the pipeline execution row
2. Click “View detail” on the dropdown:

The Details blade displays. To view pipeline run details, click the Pipeline run ID link:

Pipeline run details display:

Conclusion

In this post, I shared one way to schedule a Microsoft Fabric Data Factory pipeline, a different way to test execute a pipeline, and then one way to monitor the execution.

Learn More

Sign up for Azure QuickStart Premium from Enterprise Data & Analytics and enjoy one full year of Fabric, Fabric Data Factory, Azure, and Azure Data Factory training videos for one low price! New content is added regularly.

Need Help?

Enterprise Data & Analytics delivers data engineering consulting. Let our experienced teams lead your enterprise data integration implementation. Contact us today!