I have a feature in my Bubble App where users can send data to a google spreadsheet, the sheet runs about 3800 calculations and returns about 300 values that get stored in the bubble database.
The problem is that this process takes around 30 seconds and we have 75,000 monthly active users. So we need to set up a queueing system for the calls to run in order.
What is the best way to achieve this?
Set Up a Worker that is on/off. Then create a dataset Queue.
Workflow: All data sends create a Queue record and when processed the next Q record is sent, etc until there are no other unprocessed Q records.
Need to have a DB trigger to turn on Worker when a Q record is created and Worker is off.
BUT none of those metrics make sense - 3800 calculations, 300 return values and 30 seconds return time for 75k MU. If any of those numbers are anywhere close to reality the other numbers wouldn’t add up and they should definitely not be occurring in a google sheet but within an actual DB.
