A multi-location wellness group needed a way to automate daily file transfers from its payroll provider, Paylocity, into its Azure-based data warehouse. Rather than develop and maintain custom Python scripts, the company used Couchdrop to automate the process, delivering payroll data from SFTP to Azure Blob Storage.
What began as a single payroll integration has since expanded into more than 20 automations, helping the business manage data feeds from multiple vendors without maintaining separate scripts for each one.
The group relied on an Azure-based data warehouse to bring together information from its operations. Some of that information came from external vendors that delivered data through SFTP (Secure File Transfer Protocol), a common method for exchanging files between business systems.
One of these vendors was Paylocity, the company's payroll and human resources provider.
Each morning, Paylocity delivered a CSV file to an SFTP server at 6:00 AM. The data team needed to retrieve that file and make it available in Azure Blob Storage so it could be used by the company's data warehouse.
The requirement was straightforward, but it introduced a recurring task. Someone needed to collect the file from SFTP and transfer it to the correct destination every day.
The company wanted to automate the process rather than depend on someone remembering to complete the transfer each morning.
The team could have developed a Python script to connect to the SFTP server, retrieve the Paylocity file, and upload it to Azure Blob Storage.
However, writing the initial script would only be part of the work. The company would also be responsible for maintaining the code and managing the automation over time.
For a team responsible for maintaining a data warehouse, building and supporting custom file transfer scripts would introduce additional work outside the primary goal of making business data available for reporting and analysis.
The company needed a way to automate three specific steps:
More importantly, the team wanted a solution that wouldn't require them to write and maintain custom code whenever another vendor needed to send data.
The company worked with the Couchdrop customer success team during a guided onboarding session to configure its first automation.
The workflow was designed around Paylocity's existing delivery schedule. Paylocity would place the CSV file on the SFTP server at 6:00 AM, and Couchdrop would retrieve it by 6:15 AM.
As part of the process, the automation used dynamic variables to add the date to the filename before transferring the file to Azure Blob Storage.
This meant the company could receive the daily payroll export in its existing cloud storage environment without someone manually downloading and uploading the file.
Couchdrop handled the scheduled retrieval, filename modification, and transfer between systems through a configured workflow rather than a custom Python script.
The company was able to configure and launch the complete automation in under 45 minutes.
Once configured, the daily transfer could run without requiring the data team to initiate it each morning.
The first Paylocity workflow solved an immediate problem, but it also provided the team with an approach they could reuse for other data sources.
Payroll wasn't the only information the company needed to collect from external systems. Other vendors supplied data that was useful for understanding different parts of the business.
After implementing the Paylocity automation, the team began using Couchdrop for additional vendor feeds, including:
Although the data sources were different, the underlying requirement was similar: move files from an external vendor into the company's data environment without building a separate custom integration for every feed.
The team could apply the same general approach it had established with Paylocity, configuring new automations as additional requirements emerged.
As a result, the company now operates more than 20 automations through Couchdrop.
Rather than treating every incoming vendor file as a new software development project, the business has established a repeatable way to automate file-based data integrations.
The most immediate improvement was removing the need to develop and maintain a custom Python script for the daily Paylocity transfer.
The payroll file is now collected through an automated workflow, renamed with the date, and delivered to Azure Blob Storage for use by the data warehouse.
This also gives the company a consistent process for handling files that arrive at a predictable time each day.
The wider benefit has come from extending that approach beyond payroll.
With more than 20 automations in place, Couchdrop now supports file transfers involving several different sources of business information. The data team can configure additional vendor workflows without having to develop and maintain individual SFTP scripts for each integration.
For this business, Couchdrop has become more than a way to retrieve a daily payroll export. It provides a common approach to moving vendor data into its Azure environment.
What started with one CSV file from Paylocity has developed into a broader file automation process that supports the company's growing data integration requirements.