Our app is completely broken as it relies on scheduled wfs for things like processing orders. And now they’re just not executing and I’m really worried how long this is gonna last for. The status page isn’t super helpful just saying “We are investigating system behavior that may result in delayed task execution”. Meanwhile in the scheduler tab of my app, I see a message saying “Your scheduler is running 2 hours behind with 150K+ tasks that should have already run”
Anyone else affected by this? Have you heard anything from bubble support?
Its been since: We’ve identified the problem and the fix is being rolled out. We still have a % of our apps on the main cluster that are not running scheduled tasks or able to delete records, while the rollout is ongoing.
Scheduled workflows are still working in our app. Any updates @josh
this has been going on for 2 hours. the “fix” started rolling out an hour ago. things still aren’t working. Is it rolling out successfully and we just haven’t gotten it yet? Is there some other issue?
Thank you for the update! It’s reassuring to hear the fix is rolling out. Still haven’t seen scheduled workflows working yet on my end, but i’m hopeful now its just a matter of time
The status page helped a little, but the waiting on aws update was only posted recently and for awhile (2 hours) it was just saying the same update: “We’ve identified the problem and the fix is being rolled out. We still have a % of our apps on the main cluster that are not running scheduled tasks or able to delete records, while the rollout is ongoing.”
Which felt reassuring at first but after awhile i was left wondering how long is this fix is going to take to apply. I need to know if I should start writing hot patches to work around this issue to make things functional again in an albeit hacky way, or if I can relax and focus on reassuring my users that things will be working soon.
From what I can tell my workflows have now run. Or at least, bubble is no longer informing me that my scheduled workflows are X hours behind. I’ll still need to untangle this a bit to confirm that they ran correctly.
