Why Does Query Terminate After One Minute When Executing Workflow With Postgres DB on Pipedream?

Help
1

This topic was automatically generated from Slack. You can find the original thread here.

Hi Pipedream users, is it me or someone has faced this when executing workflow with running query against a postgres DB, query terminates after one minute, less than 1 minute query are working fine, no query timeout set on the database, workflow timeout setting more than 5 minutes, Can someone help?

image.png
image.png1032×261 34 KB

2

Maybe the Node.js Postgres DB client itself has a default of 1 min timeout?

3

Are you using a pre-built Postgres DB action in your workflow? Or Node.js code directly?

4

its just a sql statement a function that i invoke as seen below no Node.js

image.png
image.png869×1138 70.2 KB

5

Ah got it. So that still uses pipedream components under the hood.

6

It looks like the default options for the pg node lib are no timeout at all: pg.Client – node-postgres

7

It doesn’t look like any overrides are being past:

8

Are you sure your db server is configured to not timeout after a minute? That is the most likely issue I think

9

Its not configured, have just confirmed again

10

see screenshot below

image.png

11

I am migrating from shipyard since they are closing down, jobs runs fine for over 5 minutes, in pipedream it terminates after a minute

12

Could you check this setting too?
idle_in_transaction_session_timeout

13

same case 0

image.png
image.png986×236 16.1 KB

14

Hmm, then it’s looking like potentially the workflow is the culprit maybe.

Have you tried modifying the timeout on the workflow since that last time you changed it?

I wonder if the workflow’s deployment failed for some reason, maybe trying again will update the timeout

15

Something like changing it to 5 minutes and 1 second

16

let me try

17

after changing the timeout for the workflow to 301 seconds the step where the query takes more than one 1 minute still fails with the error I shared, i deployed and set it to run 8:00 P.M my local time but it has still failed

image.png
image.png919×544 45.4 KB

18

That is very weird. I think we troubleshot the best we could. Hopefully you can get more help by making a support ticket: Support - Pipedream

19

Hopefully there’s some internal logs that the PD team can see that might lead to the cause

20

Thanks for jumping in, Pierce! :pray::skin-tone-2:

are you connecting via a static IP? (either with a VPC in Pipedream or the Shared Static IP configuration for that account in Pipedream)