Accept JSON via HTTP, run Node code to transform the JSON payload, and send the data to Snowflake using Snowflake's Snowpipe ingestion service
This workflow accepts HTTP JSON payloads, transforming its body and headers, and sends the final payload to a Snowflake table using Pipedream's Snowflake integration. Pipedream did the hard work of integrating with Snowflake's Snowpipe service - all you need to do is send JSON and Pipedream will take care of the rest.
Our docs show you how to deliver data to a table with a single VARIANT column. Snowflake provides the VARIANT data type as a convenient way to query semi-structured data without having to define a rigid schema. After streaming JSON to this table, you can create other views in Snowflake, or run other transformations, to derive meaning from the raw JSON.
Copy this workflow. This copy runs in your account, and is yours to modify. The HTTP endpoint is specific to your copy of the workflow.
In the send_json_to_snowflake step, press Connect Account and enter the Snowflake credentials, table name, and other objects you created in Step 1.
Click on the Send Test Event button to send a test event to your workflow, or POST your own data to the endpoint. Pipedream will collect all events processed through the pipeline and, once a minute, deliver them to your target Snowflake table.
If you don't see data in your target Snowflake table, see our troubleshooting guide or reach out to our team.