How to export from Skyvia to an SFTP endpoint for an automated workflow

Jayden Bartram
May 19 · 4 min read

Skyvia enables you to automatically export data on a regular basis to an SFTP endpoint. When using the likes of Couchdrop SFTP, this could be utilised as part of an ETL process, primarily if you are looking to expose this data to a vendor or transfer this data to a cloud storage platform or share.

A standard example process could be similar to the below where data is transformed into a CSV and then be directly uploaded via SFTP where a webhook event is sent to a partners platform to then pull down the data for their use.

skyvia export sftp
Using Skyvia and Couchdrop you can create an automated ETL data pipeline

As Couchdrop SFTP enables you to connect any cloud storage endpoint in the backend (SharePoint, Dropbox, S3, Azure Blob, etc.) it is fully agnostic and enables you to get your data to a platform that can be utilised by yourself or an automation workflow in a simpler manner for processing. Additionally, you could combine Skyvia with another no-code platform (Zapier, Boomi or Xplenty) so that on the CSV being upload a webhook is sent and the other platform automatically pulls down the data and performs additional transformation or includes the CSV into another workflow.

How to export content from Skyvia into another workflow

  • Step 1. Create Couchdrop SFTP account
  • Step 2. Configure Couchdrop SFTP as a Skyvia connection
  • Step 3. Create an export workflow
  • Step 4. Utilise Couchdrop SFTP webhooks to initiate next step in workflow

First you will need a Couchdrop SFTP account, you can then connect your own cloud to the backend or use Couchdrop’s hosted storage. Additionally, you can create users who are restricted to certain file operations and paths.

cloud sftp skyvia workflow
cloud sftp skyvia workflow
Couchdrop SFTP web interface

Once you have a Couchdrop SFTP account you will need to create a new connection in Skyvia by clicking +NEW -> Connection.

configuring sftp skyvia
configuring sftp skyvia

Select your source connection from the drop down, in this case it is the demo DB. Additionally, choose your Couchdrop SFTP as the destination connection and select your desired target path.

export sftp workflow skyvia
export sftp workflow skyvia

Create a task and choose the objects you would like to export as a CSV file.

couchdrop sftp skyvia
couchdrop sftp skyvia

When you are ready, run the task manually to test it is working.

skyvia sftp automated workflow elt
skyvia sftp automated workflow elt

Within Couchdrop’s SFTP audit log, you will see the transaction was successful (note the upload of orders.csv)

couchdrop sftp etl workflow
couchdrop sftp etl workflow

For this step we have included Skyvia and Integromat to complete an easy to see workflow. In this situation, when Skyvia uploads the CSV file, Integromat is alerted via a webhook to then pull the file down, reupload it elsewhere and delete the file from the source. For another guide on ETL, workflows and Integromat see here.

skyvia integromat sftp workflow
skyvia integromat sftp workflow
The complete export in Skyvia
integromat etl workflow
integromat etl workflow
orders.csv uploaded via SFTP and then automatically processed via Integromat workflow
couchdrop cloud sftp extract transform load workflow
couchdrop cloud sftp extract transform load workflow
Couchdrop audit logs showing the behaviour

To get up and running with Couchdrop’s cloud SFTP server and integrate it into your automated workflow, navigate to Couchdrop’s website to sign up or learn more.

Couchdrop

Couchdrop is your cloud SFTP server and virtual file system for the cloud.

Couchdrop

Couchdrop is your cloud SFTP server. It helps you SFTP/FTP, SCP and Rsync directly into your cloud storage. Couchdrop is developer ready and offers a API and webhooks. It works with all widely used cloud storage endpoints, such as Dropbox, Box, Google Drive, Wasabi, S3, etc.

Jayden Bartram

Written by

CEO of Movebot and Couchdrop. Also have a strong passion to help businesses and people optimise and grow — jbconsulting.co.nz for more.

Couchdrop

Couchdrop is your cloud SFTP server. It helps you SFTP/FTP, SCP and Rsync directly into your cloud storage. Couchdrop is developer ready and offers a API and webhooks. It works with all widely used cloud storage endpoints, such as Dropbox, Box, Google Drive, Wasabi, S3, etc.

Medium is an open platform where 170 million readers come to find insightful and dynamic thinking. Here, expert and undiscovered voices alike dive into the heart of any topic and bring new ideas to the surface. Learn more

Follow the writers, publications, and topics that matter to you, and you’ll see them on your homepage and in your inbox. Explore

If you have a story to tell, knowledge to share, or a perspective to offer — welcome home. It’s easy and free to post your thinking on any topic. Write on Medium

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store