Cloud SFTP server for ETL workflows

A lot of extract, transform and load (ETL) platforms support SFTP as a data ingress or egress connector. The key challenge is having a scalable, fully featured SFTP server that is low maintenance and works within minutes. Couchdrop’s cloud SFTP solution can help with your automated workflows by utilising its native SFTP service, webhooks, API, cloud storage integrations and ability to create and lock down users.

ETL Use Cases:

• As a vendor your clients send you files via SFTP (or another means such as web portal) where you can receive a webhook event on upload to then initiate your ETL process.

Have your clients send you data via SFTP to then be processed through automated ETL operations

• As a client you can expose your data to your vendor for them to then process the uploaded file on a webhook event.

Expose data to your vendor to be automatically pulled into ETL operations

Example ETL Platforms:

• Xplenty
• Dell Boomi
• Informatica
• Jitterbit
• Fivetran
• Microsoft Automate

Couchdrop’s SFTP Webhooks

Couchdrop’s SFTP webhooks enable you to be alerted on file upload, download, deletion, rename or a failure. As you can see below from the example output of a webhook, there is an array of objects that can be used.

Example Couchdrop’S SFTP webhook JSON output:

{
  "account": "demouser",
  "filename": "/demo/customers/bobsburgers/burgersaucereceipe.txt",
  "authenticated_user": "demo1",
  "storage_engine": "hosted",
  "storage_engine_id": "7e88f06d-3aa5-45d9-97c2-3c5fa28ca0b4",
  "event_type": "upload",
  "ip_address": "123.253.47.202",
  "success": true,
  "total_size": 40,
  "additional_info": "",
  "system": "sftp",
  "transaction_id": "836851c7-f745-4476-8a0a-b4df14c4cd0e",
  "region": "us1",
  "text": "File /demo/customers/bobsburgers/burgersaucereceipe.txt uploaded by demo1 via sftp from 123.253.47.202"
}

To enable Couchdrop’s SFTP webhooks, navigate to your Couchdrop SFTP web portal, enable your desired events and paste your Webhook URI then save.

Couchdrop’s event notifications

Additional Users

Couchdrop provides the ability to create additional SFTP users who can be locked down to specific directories and file operations (such as write-only, read-only or read/write). There is also the ability to lock users to certain protocols, IP addresses, etc.

Create users to upload/download via SFTP

Cloud Storage Support

Although Couchdrop SFTP offers its own hosted storage as a backend, you can also connect your own cloud platform (Amazon S3, Azure Blob, Dropbox, SharePoint, etc.) and have full control or access to your data.

Couchdrop storage connectors

Connecting to ETL platform

As SFTP is a standardised protocol that is the same regardless of your ETL platform, it is the same to connect. The common required information needed is:

• SFTP hostname (sftp.couchdrop.io)
• SFTP username (Couchdrop user)
• SFTP password or key
• (Optional) SFTP root path

Microsoft Automate SFTP Connector

To get up and running with Couchdrop’s cloud SFTP server and integrate it into your ETL process, navigate to Couchdrop’s website to sign up or learn more.