Using Azure Resource Manager Templates with Azure Data Factory

Azure Resource Manager, or ARM, “allows you to provision your applications using a declarative template.” So says the Azure Quickstart Templates page. ARM templates are JSON and allow administrators to import and export Azure resources using varying management patterns. I really like ARM templates for implementing infrastructure as code in Azure. In this post I show a very simple example of how to use ARM templates to export and then import a basic ADF (Azure Data Factory) pipeline.

Export an ADF Pipeline

To demonstrate, I created the Simplest ADF Pipeline Ever containing a single Wait activity configured to wait for 10 seconds. I named the pipeline “Wait Pipeline” and the Wait activity, “Wait 10 seconds.”

When the pipeline is open in the ADFv2 editor, click the dropdown labeled, “ARM Template” and then click “Export ARM Template”:

A zip file is downloaded. Decompress the file:

Delete the Pipeline

After exporting the ARM template, I deleted the original pipeline:

Import the Template

To import the template, click the ARM Template dropdown and click “Import ARM Template”:

On the Custom Deployment page, click the “Build your own template in the editor” link to open the template editor:

When the template editor opens, click the “Load file” button to load a template file:

Select an ARM template file to upload:

Note: The file – even the number of files – will change as the resource increases in complexity.

Save the template:

Configure the “Custom deployment” blade by selecting your Subscription, Resource group, and checking the
“I agree to the terms and conditions stated above” checkbox. Don’t let the “Purchase” button throw you, click Purchase to deploy the ARM template:

Once the ARM template is deployed, the resource(s) described therein – a very simple Azure Data Factory pipeline, in this case – is deployed and available:

Summer o’ ADF 2019 Edition

this post is part of a series titled the Summer o’ ADF, 2019 Edition! Click that link to see more posts and learn more about Azure Data Factory.

Andy Leonard

andyleonard.blog

Christian, husband, dad, grandpa, Data Philosopher, Data Engineer, SSIS and Biml guy. I was cloud before cloud was cool, :{>

3 thoughts on “Using Azure Resource Manager Templates with Azure Data Factory

  1. Hi,

    Is it possible to import just one pipeline using ARM templates into an existing ADF that contains multiple pipelines?

    Thanks in advance.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.