Move SFTP, API, and webhook data into BigQuery
BigQuery is Google's cloud analytics engine designed for fast SQL queries and insights. Couchdrop can map structured files and upload them to a BigQuery database as part of an automation.
Category
Type
Integrate BigQuery with Couchdrop
How it works
Couchdrop turns inbound file transfers into a direct ingestion path for BigQuery, helping teams move operational data into their warehouse without building a separate ETL layer.
Files can arrive in Couchdrop from sources such as cloud storage, SFTP and FTP servers, APIs, or inbound webhooks. From there, a Transfer Automation or File Action can use the BigQuery platform integration to stream structured or semi-structured file contents into a target BigQuery table.
Because Couchdrop needs to translate file contents into BigQuery rows, BigQuery is configured as a system integration rather than a standard virtual folder. During setup, you provide the destination table details and map the incoming file data to the schema BigQuery expects.
Capabilities
- Move structured and semi-structured file data into BigQuery tables
- Ingest files received through SFTP, FTP, cloud storage, APIs, or inbound webhooks
- Use BigQuery inside Couchdrop Transfer Automations and File Actions
- Map incoming file fields to the destination BigQuery table schema
- Stream file contents into your data warehouse for analysis
- Use service account credentials for secure Google Cloud authentication
- Reduce custom ETL work for recurring partner, customer, or application data feeds
Getting started
- Create or identify the BigQuery table you want Couchdrop to upload data into.
- Collect the required table details, including the Google Cloud project ID, dataset name, and table name.
- Create a Google service account in APIs & Services → Credentials, then generate and download the service credentials JSON file.
- In Couchdrop, add a new system integration and select BigQuery.
- Provide the BigQuery table details and service credentials JSON.
- Click Add System Integration.
- Create a Transfer Automation or File Action and choose BigQuery as the platform type.
- Map the incoming file structure to the BigQuery table schema, then test the workflow with a representative file.