Any experience sending 50k+ rows to Bubble.io Data API?

vovahumnytskiy · 2022-11-08T14:11:12.496Z

Hey,

Looking for someone who sends large datasets to Bubble on a regular basis from other applications using Bubble Data API.

Are there any issues? Can Bubble handle it? Any workflow errors/delays?

Will be happy if someone with this experience can comment.

redvivi · 2022-11-08T14:14:49.710Z

I would highly suggest to implement pagination…your ask is more related to software architecture than pure Bubble performance.

Processing large amount of data has the potential to crash any app if not designed properly.

vovahumnytskiy · 2022-11-08T14:22:41.002Z

I am concerned about the paragraph.
https://manual.bubble.io/core-resources/api/data-api#bulk-create-new-things
Sounds like my bulk update would take 3-4 hours while I need 3-4 minutes.

This also sounds like there is a big chance that a lot of the data will be lost or incorrect

Screenshot 2022-11-08 at 16.21.301554×320 155 KB

redvivi · 2022-11-08T14:34:25.546Z

vovahumnytskiy:

Sounds like my bulk update would take 3-4 hours while I need 3-4 minutes.

Given the volume involved, perhaps you would like to reconsider your source of data, instead of replicating your dataset to Bubble then…

vovahumnytskiy · 2022-11-08T14:37:29.253Z

Ha-ha,

Yes, I am thinking about this

Need an external dabase tip Database

Hey-hey, We are reaching the limit of our Bubble database. Are there any success stories moving data outside of Bubble AND achieving better load speed and performance? Thinking between Xano, MongoDB & BigQuery… Afraid of getting the same speed upon migration or worse.

vovahumnytskiy · 2022-11-08T16:29:06.434Z

Have anyone used Digital Ocean database for a goal like mine?