Hi – I need a handful of volunteers to help us debug. If you’re based in Brazil, currently experiencing this issue, and able to be online and responsive for the next 15 minutes, please DM me
Thanks @rpetribu and @loreno for volunteering. If it’s working for you again, don’t do this, but insofar as you are still seeing this issue, please gather the following data and send me a DM with this:
Turned cloudflare on again in my domain settings and re-did my DNS records and I’m getting some positive reports from customers being able to access it.
Hey everyone, it’s back to normal here.
Thanks to Josh and the entire team who worked on this so promptly—and especially to the Brazilian community, without whom it would have been unlikely for the internal team to become aware of the issue, since it was theoretically a local problem (Brazil).
@Josh, please let us know what exactly caused this problem and if there’s anything we can do on our end to resolve it.
Thank you everyone in the Brazilian community for highlighting the problem here! @fede.bubble for triaging and @josh for mobilizing the team. Please relay our thanks to the engineering team as well.
If possible I’d also kindly ask to keep an extra eye out tomorrow for this problem somehow resurfacing. We have a huge event using our bubble application tomorrow and I’m so grateful this happened today and not tomorrow
Thanks for everyone who volunteered to help us debug!
We isolated the issue to networking between CloudFlare and certain ASNs in Brazil. CloudFlare is doing an investigation on their end using the data we provided them, and will circle back to us with their findings. There are no recommended changes or actions on your end as Bubble users.
We’ll keep an eye out for a recurrence here, and please let us know if you see the same symptoms recur