SQL Server on-prem to Azure SQL PaaS — Azure Data Factory
Hey Guys, these days I’m working on a project where the team is extracting data of the ERP system and dumping into an Azure SQL Server PaaS instance to be used by another application.
The application team was trying to use a feature of SQL Server 2016 called Linked Server to make this copy. They would run a script that would copy specific data and dump into Azure.
However, the Senior DBA stopped this operation as this is not recommended and not supported. It also doesn’t work.
We started to use the Azure Data Factory service in Azure. This enabled us to run different pipelines that connect to an agent installed on the on-premises network and dump this data on to an Azure SQL PaaS. All automated and scheduled.
Azure Data Factory is Azure’s cloud ETL service for scale-out serverless data integration and data transformation. It offers a code-free UI for intuitive authoring and single-pane-of-class monitoring and management. You can also lift and shift existing SSIS packages to Azure and run them with full compatibility in ADF. SSIS Integration Runtime offers a fully managed service, so you don’t have to worry about infrastructure management.
This is only one feature of the Azure Data Factory. This is a huge tool that facilitates the data move from on-premises.
This service is cheap, for basic usage you would pay something around £10 per month.
For more information on the capabilties of the Azure Data Factory refer to the documentation on the link below.
