Workato supports native SFTP as a platform to import and export files. By using this native integration you can utilise it for your extract, transform and load (ETL) workflows and file automation requirements. The key challenge is having a scalable, fully featured SFTP server that is low maintenance and works within minutes. Couchdrop’s cloud SFTP solution can help with your automated workflows by utilising its native SFTP service, webhooks, API, cloud storage integrations and ability to create and lock down users.
ETL Use Cases:
- As a vendor your clients send you files via SFTP (or another means such as web portal) where you can receive a webhook event on upload to then initiate your ETL process.
- As a client you can expose your data to your vendor for them to then process the uploaded file on a webhook event.
An example of an ETL operation with Workato would be a finance company who receives financial information from external clients via Couchdrop SFTP or Couchdrop’s web portal. From there a webhook would be sent to Workato which will then pull down the file that was uploaded and perform ETL operations as required.
This article will run you through an example of a workflow using Couchdrop’s SFTP and Workato.
The steps required:
- Step 1. Create a Workato recipe that is triggered by webhook
- Step 2. Configure Workato JSON webhook
- Step 3. Configure Couchdrop with webhook URI
- Step 4. Configure SFTP module for file download
- Step 5. Conduct operation on file
Step 1. Create a Workato recipe that is triggered by webhook
Create a new recipe under your desired folder that is triggered from a webhook.
Step 2. Configure Workato JSON webhook
Select guided setup and provide an event name
Ensure the Webhook type is ‘JSON payload’
Use a JSON sample (see below) to provide the fields and generate the JSON schema
Sample Couchdrop SFTP webhook output:
"text": "File /demo/customers/bobsburgers/burgersaucereceipe.txt uploaded by demo1 via sftp from 188.8.131.52"
Step 3. Configure Couchdrop with webhook URI
Find your desired folder you wish to have this webhook trigger on and paste it under the folder properties then save.
Step 4. Configure SFTP module for file download from Couchdrop
Configure the SFTP module in Workato using your Couchdrop credentials and sftp.couchdrop.io as the SFTP endpoint hostname.
Step 5. Conduct operation on file
For this scenario we are repurposing the SFTP connection to download the file, upload it to another location and then delete it. This may not be the best example, but it shows the possibilities with SFTP. After the file is downloaded, you could upload it to a CMS or another solution to then be processed.
To get up and running with Couchdrop’s cloud SFTP server and integrate it into your ETL process, navigate to Couchdrop’s website to sign up or learn more.