Self-Hosted Integration Runtime πŸš€ Vs Azure Integration Runtime ☁

Difference between Azure Integration Runtime and Self Hosted Integration Runtime and how to set it up

Ravi Kumar
Towards Data Engineering
4 min readDec 13, 2022

--

The topic of content:

  • What is Integration Runtime?
  • What is Azure Integration Runtime?
  • How to create an Azure integration runtime?
  • What is Self-Hosted Integration Runtime?
  • How to create a Self-Hosted Integration Runtime?
  • Conclusion

What is Integration Runtime?

Integration Runtime is the computation infrastructure used by Azure Data Factory and Azure Synapse pipelines for data movements from On-premise (Private network: Can be a shared network drive, SQL server, or any sort of private data storage device) to cloud or cloud-to-cloud.

On-Premise Vs Cloud

Activities that can be performed using the IRs are:

  • Copy data
  • Transform data
  • Execute activities

And it can be from cloud to cloud, on-prem to on-prem, on-prem to cloud, and cloud to on-prem.

What is Azure Integration Runtime?

Azure integration runtime

Azure Integration Runtime:

  • Here all the hardware and infrastructure are managed by the Microsoft team, you just have to pay as per your usage
  • It can only access the data stored in public network
  • You can create it specifically region wise, to ensure that the data stays in the certain mentioned regions only

Transformations that can be done:

  • Copy between cloud stores
  • Transform data between clouds
  • Execute Activities using cloud and linked services

To read more in detail refer to the official documentation.

How to create an Azure integration runtime?

  • Go to the manage section of your ADF and select integration runtime and create a new one
  • Once you will click New, you will be able to choose an option like azure, or self-hosted (We are not going to discuss SSIS since it is not too widely used)
  • The last step is to give a proper name, select the region as per your requirement and press create, all the billing will be as per your usage

What is Self-Hosted Integration Runtime?

Self-hosted integration runtime

Self-hosted Integration Runtime:

  • Here all the hardware and infrastructure are managed by an Individual
  • Individuals take care of scaling, installation patching, etc
  • It can access resources in both public and private networks

Transformations that can be done:

  • Copy data between cloud and on-premises stores
  • Copy data between on-premises stores
  • Execute activities using on-premises stores and linked services

To read more in detail refer to the official documentation.

How to create a Self-hosted runtime?

  • Go to the manage section of your ADF and select integration runtime and create a new one
  • Once you will click New, you will be able to choose an option like azure, or self-hosted, select the self-hosted option
  • Give a proper name and click create
  • You have two options to set up self-hosted IR, use anyone to set it up (To learn more about both options refer to this video)

Conclusion

Here in this article, we learned the meaning of integration runtime, different types of integration runtimes, and how to set them up.

Want to read more: https://medium.com/@ravikumar10593/

Find my all handles: https://linktr.ee/ravikumar10593

If this article helped you don’t forget to Follow, like, and share it with your friendsπŸ‘Happy Learning!!

--

--

Ravi Kumar
Towards Data Engineering

Hey Techies!, I am here to share my learning about different tech, tools, business and automations, for more details: https://linktr.ee/ravikumar10593