System Maintenance: Short delay in processing new events between 11:00 and 11:15am PT

We’re performing a database migration that will require us to pause the processing of incoming events for a short period of time, as we make the cutover. This maintenance will start today at 11:00am PT, and should last roughly 15 minutes.

During the maintenance window, incoming events will be queued, but sources and workflows will not process those events until after maintenance is done.

We’ll post here when the maintenance is complete.

1 Like

Migration in the middle of the work day?

3 Likes

Interestingly, I had another external service we use that also just upgraded in the middle of the day, and broke everything. Might be unrelated, but it’s seemed sort of odd to see 2 companies engage in sudden upgrades in the middle of the day. Is some major provider forcing some sort of upgrade?

All of our API Requests have simply stopped responding and now throwing errors.

blocked CORS policy or something else?

Hello.Any updates?It is already 11:40 AM PT…System seems to be still unresponsive

1 Like

No. We are not using browser. This is server to server. The triggers that use URLs, HTTP requests, now all return 502 to the calling the server. the requests are shown in pipedream as completed but servers get 502. Breaking everything.

Hello. Suddenly all of the wrokflows that I have that call other workflows respond with 502 errors. Is this due to maintenance?

1 Like

Same here. I think it is due to maintenance activity

We have the same exact error. This utterly absurd. Who does system maintenance in the middle of the day!

Getting similar problem, guess we have to wait until we get a response. I’m getting major trust issues at the moment.

Yes, this was a forced migration by one of our providers. We realize this is not ideal, and we obviously do not take this downtime lightly. In this specific case, we had limited options. We apologize for the issues that resulted from the migration, and are working to resolve them ASAP. I’ll post here again when that’s done.

2 Likes

Out of curiosity, can you share the provider?

Redis Labs

1 Like

Why did you do a system Maintenance during workday? All of my API systems in multiple departments are down and my workflow automations don’t work anymore and it’s hurting our clients

Service should now be restored. Let us know if you observe any lingering issues — we’re happy to look into it.

my 502 errors have gone, i replayed the workflows and they went through.
remember: it was mid of day only in US, here in Europe the maintenance time was absolutely OK, it is late evening.

1 Like

my workflows are running again as well. i will have to replay quite a few though. thanks for the updates

Working again. Thanks for getting this back so quickly! My other service was down for 12 hours!

Thank you for fixing it!!