How we save time when moving Azure Data Factory Integration Runtimes

Eugene Niemand
Feb 7 · 3 min read
Image for post
Image for post

If you are using Azure Data Factory (ADF) and need to access data outside of Azure you need to install an Integration Runtime (IR) on a Virtual Machine (VM) that does have access to the data. At ASOS we have some sources that are still on premises or within VNETs in which case you need an IR. We are always evolving our implementations and recently had to split one of our solutions into two, which meant we had to reconfigure the IRs in multiple environments to connect to different ADFs in other Azure subscriptions.

The current recommendation of re-configuring an instance is that you cannot enter another key and you will need to reinstall it. However, there is a much easier way to do this using a single line of PowerShell.

Azure Data Factory

In your ADF go to the Connections section then select the Integration Runtimes (IR) tab. Here you can add and edit IRs as well as get more info about them. Click the edit button (Fig 1) for your chosen IR.

Figure 1 — Integration Runtimes overview

You will be presented with the following screen (Fig 2). Copy Key 1 or Key 2 to your clipboard or somewhere else as we will use it soon.

Image for post
Image for post
Figure 2 — Integration Runtime Settings

If you select the Nodes tab (Fig 3) you will notice that there aren’t any running nodes for the selected IR

Image for post
Image for post
Figure 3— Nodes Overview

On the VM hosting your IR

Remote Desktop into the VM hosting your IR and open PowerShell. Execute the below command. Remember to add the key you copied earlier to the gatewayKey parameter.

& “C:\Program Files\Microsoft Integration Runtime\3.0\PowerShellScript\RegisterIntegrationRuntime.ps1” -gatewayKey <YourKeyCopiedInPrevStep>

It will take about a minute to execute and it may look like its hanging as there is no feedback or progress updates until its completed. After successful execution you should see a message like the one below (Fig 4)

Figure 4 — PowerShell Output

You can also open the Microsoft Integration Runtime (Fig 5) from the Start Menu and confirm that the Data Factory displayed is indeed the one that you want to connect to.

Figure 5— Microsoft Integration Runtime

Back in Azure Data Factory

When you look at Nodes now you should see (Fig 6) the new node added and in a running status. You may need to refresh the page to see this.

Image for post
Image for post
Figure 6— Nodes Overview

About the author

Eugene is a Senior Data Engineer at ASOS with a passion for Test Driven Development, Agile Methodologies, Continuous Integration and Delivery using Microsoft Azure. In my spare time I tinker with Home Automation.

Eugene Niemand’s Blog

Technology and Programming professional and enthusist

Eugene Niemand

Written by

Lead Data QA Engineer at ASOS.com - I have a passion for Test Driven Development, Agile Methodologies, Continuous Integration and Delivery using Microsoft Azure

Eugene Niemand’s Blog

Technology and Programming professional and enthusist

Eugene Niemand

Written by

Lead Data QA Engineer at ASOS.com - I have a passion for Test Driven Development, Agile Methodologies, Continuous Integration and Delivery using Microsoft Azure

Eugene Niemand’s Blog

Technology and Programming professional and enthusist

Medium is an open platform where 170 million readers come to find insightful and dynamic thinking. Here, expert and undiscovered voices alike dive into the heart of any topic and bring new ideas to the surface. Learn more

Follow the writers, publications, and topics that matter to you, and you’ll see them on your homepage and in your inbox. Explore

If you have a story to tell, knowledge to share, or a perspective to offer — welcome home. It’s easy and free to post your thinking on any topic. Write on Medium

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store