File transfers are an important part of any business. However, sometimes moving the files alone isn't enough. They may come in an incompatible format or state to be used by other applications that need to ingest them.
This is where ETL/ELT processes come in. ETL stands for Extract, Transform, Load, and are used in data pipelines to move and transform large quantities of data reliably and automatically, and then load it into another system.
However, where ETL platforms are often lacking is data ingestion: how does data securely get into the platform in the first place when it can be sourced from multiple disparate systems?
Combining a file transfer platform like Couchdorp with an ETL system like Skyvia helps solve both of these problems. By combining the two solutions, you can maximize data versatility and move data freely, at scale, and without manual intervention.
What is Couchdrop?
Couchdrop is a cloud-native SFTP and MFT platform that facilitates fast and secure file transfers between different storage systems. With Couchdrop, you have full control of your data and bring your own storage. No data is ever stored by Couchdrop at any stage, which makes it ideal for transferring sensitive data like HIPAA data and financial information.
When it comes to secure file transfer, Couchdrop’s security and versatility make it an ideal choice for any organization that needs to regularly move files between systems. However, some organizations need more direct connections to platforms like Salesforce and need to sync databases as well as move files.
This is where a product like Skyvia comes into play, and combined with Couchdrop, you can easily get your data where it needs to be.
What is Skyvia?
Skyvia is a cloud data platform used for backups, data integration, and access & management. It can help organizations move or replicate data, such as extracting data from multiple platforms and consolidating it in one place or syncing relevant data across several systems automatically.
As a completely cloud platform, you can access your Skyvia environment from anywhere with no need to install and administer software locally.
The Skyvia platform includes several different products: Data Integration, Automation, Backup, Query, and Connect. They support several different protocols, including SQL, ODBC, OData, and ADO.NET. With this versatility, Skyvia has over 200 pre-built connections including Excel, HubSpot, and Salesforce.
However, Skyvia doesn’t support some direct connections that would be beneficial for organizations. Instead, sometimes it first needs to transfer that data through a protocol like SFTP, which is where Couchdrop comes in.
Simpler data connections with Skyvia and Couchdrop
Couchdrop takes the complexity out of SFTP with a simple setup that doesn’t require working in a terminal or writing out a config file. Setup is done automatically upon making an account, and settings are all managed through the simple web interface.
As a cloud-native SFTP platform, Couchdrop was designed to work with the cloud. Connecting storage systems like on-premise servers or cloud storage is simple and can be done in minutes.
Combining simple SFTP with Skyvia’s wide range of integrations allows fast and simple file transfers across an enormous range of applications.
Connecting Skyvia and Couchdrop
The primary way to connect Couchdrop and Skyvia is by using Skyvia's SFTP connector. The connector asks for basic SFTP server information to allow you to connect as a specific user.
We recommend creating a user in Couchdrop for this specific purpose. Admins can create a user manually or autogenerate a user with a particular permissions set, such as SFTP access. You can also isolate the user to a specific folder--such as one for Skyvia--to ensure the user that will be used for the Skyvia connection only has access to the folders you want to use with Skyvia.
After creating a user, you can see details for how to connect as them at any time. Add the user information into the Skyvia SFTP connector and you can start using it immediately for workflows.
So why use Couchdrop over other SFTP servers for your Skyvia flows? There are several important benefits, including:
- Instant setup - Your SFTP server is set up immediately at sign up and you never have to manage infrastructure.
- Platform connectivity - Connect to over 30 cloud storage providers via SFTP, allowing for direct storage and SFTP connections.
- Comprehensive reporting - All file transfers and system events are logged and reported and can be sent to your SIEM system.
- Web-based management - Couchdrop is fully managed online with a modern web interface you can access from anywhere.
Since Skyvia has over two hundred built-in connectors and Couchdrop can securely transfer files between over 30 cloud storage providers as well as on-prem OSX or Windows servers, combining the two will handle numerous situations where you need to move files.
Below are a few of the use cases for combining Skyva and Couchdrop.
Skyvia and Couchdrop use cases
Couchdrop and Skyvia can significantly reduce the need for manually updating and moving files, decreasing the potential for errors and increasing efficiency.
CSV data loading from Salesforce with Skyvia and Couchdrop
A powerful way to combine the functionality of Skyvia and Couchdrop is by using Skyvia to update or sync data across platforms and then move these updated files using Couchdrop. A common need is to do with Salesforce files and then move files to a new file storage, which can be a challenging, time-consuming process without the proper tools.
Suppose that an organization has several different departments with their own expense reports in Salesforce. Then the accounting department requests both the individual reports as well as a consolidated report with the total expenses from all departments in a single file.
Skyvia can consolidate the data from these different spreadsheets into a single file. Using Skyvia’s Integrations with the Import function, users can connect to Salesforce quickly and easily to retrieve the spreadsheets.
Once connected, users can map columns from the source into the target file and let Skyvia handle the rest. After repeating the process for each department’s file, they can generate the consolidated file quickly whenever needed, or choose to generate the file on a schedule with Skyvia’s Automations.
Distributing files via SFTP
Another way to combine Couchdrop and Skyvia is to distribute files via SFTP. Skyvia can easily pull files from CRMs and other data sources. Then you can use Couchdrop to distribute those files to different platforms.
For example, you can start by having Skyvia process files from any source. Then you can use Couchdrop to connect to a SharePoint site via SFTP and move processed files into specific document libraries for users to act on.
Couchdrop can even be used as an FTP/SFTP bridge, which means you can keep the pipeline secured when involving systems that can only communicate via FTP.
Try Skyvia and Couchdrop for free
Both Couchdrop and Skyvia offer free trials so you can try the products firsthand and make sure that they’ll suit your requirements. You can see the difference between Skyvia plans and sign up for the Free plan on the Skyvia pricing page.
With Couchdrop, you can get a 14-day free trial without any feature limitations. No credit card is required, so you won’t be subscribed unintentionally at the end of the trial. Simply complete the quick registration, and your SFTP server will be set up automatically. Get started now by registering for your free trial.