Good day fellow Bubblers! I am new to the community and am busy with my first project build. I need some advice.
I need a way to automatically clear a specific database type daily, and upload new data to it. The problem I am having is that the amount of data is huge. It is a csv file of just less than 600 000 rows. Is there any way this can be done? Either with a workflow, plug in or external tool or service. I don’t mind housing the data outside of Bubble if that would be the best way to do it, as long as it is easy enough to interact with and obtain the data via api to be used and displayed in the app I am building. Any suggestions at all?
Hi @ctu, congratulations for booking your first Bubble project!
Regardless of where you decide to host your data, you can use Scheduled Workflows to automated daily tasks like database maintenance.
Take a look at Bubble pricing, the storage Bubble provides can be limited and expensive if you need to store a lot of data. There are a lot of alternatives, depending on the type and size of data you want to host. For projects that requires a lot of data, I like using AWS services (S3, Dynamo or RDB), when used together with AWS API Gateway it can be easy to integrate with. With that said there are a lot of options out there…
