Incident postmortem from 11/29

Updated OP with postmortem

5 Likes

Thanks @josh! Always love the transparency on what happened and what Bubble is going to do about it moving forward!

Quick question: what’s the difference between the 24/7 support response vs. the regular response team? Does the regular response team have protocols in place for escalation? Did the 24/7 support team attempt to communicate with those submitting requests in (or was it a flood that couldn’t all be answered right away)?

Does anyone monitor the support inbox for emergencies outside of regular business hours?

Edit: On the statuspage, there is just one component called Main Bubble Cluster. Does that include all of the editors?

Thanks very much for the public post mortem. It’s very important for brand trust, and I’m grateful you agree!

Thanks a lot @josh - excellent writeup.
Could you elaborate how one app created this many temporary users that needed deletion? Was there a loop made by the dev, bots or something similar?

:popcorn: :popcorn: :popcorn: :popcorn: :popcorn:

5 Likes

Hey, we really are a nice group of people here on the bubble forum. We are a friendly and extremely helpful community. From time to time we all have bad days or get frustrated by something which results in some of us being more passionate than compassionate. I’ve done this many times but trust me it ain’t personal.

Also, for some of us that literally live on this forum all day, we sometimes get frustrated by others that complain about bubble not meeting their expectations which are sometimes unrealistic for bubble’s current stage of growth.

Welcome aboard and avoid wasting your energy taking some posts to heart. They really really don’t mean it personally. Hear what they are trying to convey and dismiss whatever snark comments get sprinkled in. We are all guilt of it.

5 Likes