Same here… any call towards an internal API is broken! My users CAN’T LOGIN! I don’t know what’s worse
The fact that it’s a suspected DDoS makes it moderately less Bubble’s fault, fortunately.
Yeah, I’ve found this has noticeably improved in the last 6 months so credit where credit is due, but unfortunately that’s all that’s improved with the reliability aspect 
2 Likes
While I’m 100% upset as much as you - Nick just notified the community that Bubble team is aware and investigating. That’s much better than it used to be when nobody from Bubble team appeared on the forum while downtimes 
3 Likes
Idk if this is related but my mobile forums is also broken after the fix. Font fallbacks and sizing are all whack.
Time to touch grass. Goodluck on fixing.
1 Like
Hi all,
Earlier today, we had two infrastructure incidents. The first one was a database latency issue that caused downtime for some of our main cluster apps, and lasted from approximately 3:02pm to 3:26 pm ET. The second one was a denial-of-service attack that caused downtime for all main cluster apps, the editor, and the subset of Dedicated functionality that depends on the main cluster. It lasted from 3:36 pm to 4 pm ET (with some issues lingering til approximately 4:10 pm ET).
Both incidents were caused by changes in traffic/behavior of apps that we host, and were not a result of us shipping code or otherwise changing our systems. We will share a postmortem and action plan later this week. I consider increasing Bubble’s uptime my highest priority right now, and we are going to move even faster to make our systems resilient to these kinds of outages.
21 Likes
Ok , own up, who created workflow-zilla and crashed bubble?? 
3 Likes
oh how i wish it was me, @chad
thanks for the update @josh
this isnt the first DDOS attack bubble has had to mediate. are there any plans to allow for non-dedicated instances? like a docker container running in the the cloud of our choice or whatever? Also, not dogging you guys here. Great work getting the ship back on course whenever a strong gust of wind comes along!
3 Likes
I’m curious, a few people noted and posted screenshots of their editor than had the mobile app functionality pieces visible under the settings tab.
How did that happen if it was not a result of shipped code or system changes?
Unsure if this is even possible but was it related to the database issue? Like where people were seeing things they weren’t intended to see? If so that seems like a security issue. (This seems unlikely to me but if code wasn’t shipped how did such a thing happen?)
3 Likes
Also, it appears this was a much more spread attack, shopify, quickbooks and several more services were down on the same timeframe, could we be looking to an attack directed to Cloudflare directly? Or is Bubble hosted in the same cluster/servers as those services?
1 Like
I was 90% the way through tagging you specifically to ask if it was you @jared.gibb who caused this and then I didn’t.
Lost opportunity
1 Like
Yes, please 
1 Like
That would be freaking amazing
1 Like
Yeah…I’m jealous!!!
run as doesn’t seem to be working for me. Anyone?
nevermind, switching branches, deselected the page, and befuddled me.
Are we down again?
Nope, looks like everything is working to me: https://status.bubble.io/