Database update performance was great!

Just passing by to thank the whole team responsible for the database update this month.

I’m not entirely sure on when this change was finished, but I just noticed that the function of copying the live database to dev database is absurdly faster!

TLDR: We’re just short of 1M records on a table (around 110k users), and that function took about 9 hours the last time I used it (and we had fewer records). Today, I triggered on a browser tab and forgot about it, thinking it should be done sometime around Monday morning. I just realized it was already complete! It was done within minutes!

Anyways, again, just appreciating the input among so many critics (including mine). Thanks again, very nice job!

10 Likes

good to hear, i wonder what other improvements we have

@fede.bubble

I see 600ms-400 ms performance increase on load (especially on fcp), and better cache, is this true also ? or placebo ?

Performance improved a lot, creating new things in db is faster now, almost instant.

2 Likes

I got excited and started a full db live to dev copy last night, sadly it is still going and probably won’t be done until about 24 hours, which has been the norm over the past several months.

When was the last time you did a copy where it was different than now? My guess is that maybe with a single data type there could be some improvements, but with a full db copy it still takes way too long compared to traditional solutions.

Hi @maw. Sorry you had that experience. I did it last year.

How many records you have when taking that long?

I’m doing one now for around 3.7M data records (not counting tiny tables). Starting right now as I click to post. I’ll be back once I see the email about being finished

#EDIT: It seems they’re not sending emails. Either that, or is not finishing up? The biggest tables look good. Looks finished

Hey all, Rutvij here from the Bubble team. Not a placebo @th18 , you are right, the DB performance for creating, editing, and retrieving has improved! Josh covered it in his monthly forum post - copying and pasting here:

We upgraded our platform’s database, which improved the speed of a number of data operations and overall performance. The biggest wins we’re seeing are in operations that insert or update data, up to 25% faster. Searching databases is up to 20% faster, and retrieving data is up to 11% faster. I know that work that requires downtime on your end can be stressful, but I’m very pleased that this work means better performance across the platform. Thanks for your patience there.

2 Likes

Yeah, they don’t send emails when a copy function is done, @fede.bubble would be great if they could add this, shouldn’t be a big lift at all.

We have a very large database with over 100 data types so definitely don’t expect it to be super fast, but almost 24 hours is not comparable to traditional database copies.

@rutvij.bhise FYI, I don’t believe Josh’s update was related to doing the DB copy function in the Editor … for exporting data or doing other backend functions, that may be improved, but not with doing a full DB copy from the editor.

Yes @maw that’s right, I was replying to @th18 ‘s specific post. Sorry, can see how using “you all” there was confusing, have edited my post