How we save time when moving Azure Data Factory Integration Runtimes

Eugene Niemand
Feb 7 · 3 min read

If you are using Azure Data Factory (ADF) and need to access data outside of Azure you need to install an Integration Runtime (IR) on a Virtual Machine (VM) that does have access to the data. At ASOS we have some sources that are still on premises or within VNETs in which case you need an IR. We are always evolving our implementations and recently had to split one of our solutions into two, which meant we had to reconfigure the IRs in multiple environments to connect to different ADFs in other Azure subscriptions.

The current recommendation of re-configuring an instance is that you cannot enter another key and you will need to reinstall it. However, there is a much easier way to do this using a single line of PowerShell.

Azure Data Factory

In your ADF go to the Connections section then select the Integration Runtimes (IR) tab. Here you can add and edit IRs as well as get more info about them. Click the edit button (Fig 1) for your chosen IR.

Figure 1 — Integration Runtimes overview

You will be presented with the following screen (Fig 2). Copy Key 1 or Key 2 to your clipboard or somewhere else as we will use it soon.

Figure 2 — Integration Runtime Settings

If you select the Nodes tab (Fig 3) you will notice that there aren’t any running nodes for the selected IR

Figure 3— Nodes Overview

On the VM hosting your IR

Remote Desktop into the VM hosting your IR and open PowerShell. Execute the below command. Remember to add the key you copied earlier to the gatewayKey parameter.

& “C:\Program Files\Microsoft Integration Runtime\3.0\PowerShellScript\RegisterIntegrationRuntime.ps1” -gatewayKey <YourKeyCopiedInPrevStep>

It will take about a minute to execute and it may look like its hanging as there is no feedback or progress updates until its completed. After successful execution you should see a message like the one below (Fig 4)

Figure 4 — PowerShell Output

You can also open the Microsoft Integration Runtime (Fig 5) from the Start Menu and confirm that the Data Factory displayed is indeed the one that you want to connect to.

Figure 5— Microsoft Integration Runtime

Back in Azure Data Factory

When you look at Nodes now you should see (Fig 6) the new node added and in a running status. You may need to refresh the page to see this.

Figure 6— Nodes Overview

About the author

Eugene is a Senior Data Engineer at ASOS with a passion for Test Driven Development, Agile Methodologies, Continuous Integration and Delivery using Microsoft Azure. In my spare time I tinker with Home Automation.

Eugene Niemand’s Blog

Technology and Programming professional and enthusist

Eugene Niemand

Written by

Senior Data Engineer at ASOS.com - I have a passion for Test Driven Development, Agile Methodologies, Continuous Integration and Delivery using Microsoft Azure

Eugene Niemand’s Blog

Technology and Programming professional and enthusist

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch
Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore
Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade