We have a customer base of about 5000 subscribers that are charged weekly. I’m looking to use bubble to handle that process via braintree.
I have concerns about Bubble’s reliability if I am going to trust it schedule charging customers (in braintree) via an api because in my experience bubble tends to slow down on large processes and skip rows in the database. I also happen to know bubble cant even create unique sequential numbers (in a post I started years ago) so I’m guessing the answer is not to trust it.
However if anyone can advise they process over 5000 customer payments reliably (or not) I’d love to hear about it as I really would like to use bubble but performance and reliability have always been sketchy at best. Perhaps bubble has improved in the last few years since I last built anything substantial in it? I genuinely hope so.
Hi @morgan !
5000 unique numbers … create 5000 things and retrieve their unique IDs
Run 5000 flows … schedule 100 of them at a time recursively … very reliable
2 Likes
Thanks for your response, so you’ve done this yourself? With payments? My experience is that bubble sometime inexplicably misses rows. I cannot afford for it to be unreliable in any way.
I am in the process of testing them however
The most reliable thing I’ve done is schedule a workflow. Pass that workflow a list. Do some action on the first item in that list. Remove the first item from said list. And then schedule that same workflow sending the remainder of that list of items. Do you know some real recursive action. I am not a fan of using bubbles action on list of items. It doesn’t seem to work well enough for me and it maxes out my server too often for my comfort. I find that doing a recursive action and adding a pause of a half second to a second before it makes the next call is the most reliable thing for me.
The quick and dirty is that bubble is not really great for handling large amounts of items to be processed quickly. Sure I can handle large amounts of items, but to handle them quickly is another issue.
4 Likes
Yes Agreed. How about using the mysql connector so it queries a mysql database and updated the rows in the database. I have used it before and it runs fast as it’s not relying on bubble’s antiquated and slow database but not sure if that would work better?
Personal opinion follows:
I am a huge fan of what Bubble has created. However, at this point in time, I would not trust a Bubble workflow to complete a large processing task that is of critical importance like account billing.
We have a fairly simple scheduled workflow that was running against a lot of records that would randomly fail on us inexplicably. If we kicked off the workflow manually, it completes perfectly every time.
In my opinion, part of the larger issue is that you have no way of knowing when these failures happen, the workflow just dies. What you generally see recommended is to have a second workflow, checking to see if the first workflow is still running and if it’s not then to start it again. With a non-critical task, this is probably acceptable, but for our businesses billing is a critical process that must be reliable. We handle this with a traditional APIs and/or Azure Functions / AWS Lambda / etc.
One point of clarity, if you have 5,000 customers and they all are billed at various random points throughout the week (typically based on what day/time they signed up), one account at a time, this is no problem for Bubble and we haven’t seen any issues in our apps. However, if you are trying to loop over 5,000 accounts and bill them all at the same time, one right after the other, this is the type of processing that I wouldn’t trust with a Bubble workflow.
2 Likes
@bubble.trouble
On each pass in the backend, create logic that records successes and failures. Also create logic to record completion of 5000 passes to get 5000 s/f’s.
You can also create notifications or emails.
1 Like
Thanks for your note. It reflects my experience and sentiment precisely. In our case we will not be able to trust bubble to handle the workflow. It is such a shame that the bubble backend is unreliable. I’m pretty sure it runs on node.js which is a toy compared to something like Go(lang) that we will build our own backend on.
1 Like
our app runs a workflow every minute, which creates 1k entries per day, since 6 months. not related to payments but without it the app would not work.
I have a flow that runs to check the 1k entries for errors and alert me if a certain number isnt reached.
I have a flow that acts as a backup workflow if that workflow fails if bubble is down.
Errors of about 30 rows come up once in 3 months. But can be found and fixed. Mostly related to capacity it seems. Often it helps spacing out the workflow into A runs B which runs C which runs D, instead of everything in A and B.
If to proceed is your decision
3 Likes
I have implemented a scheduled recursive workflow to process thousand’s of records daily to call a specific API, each of the records having an associated completion state, plus the target API is handling success/failure response codes to then update each row’s status accordingly.
So I would say it is entirely dependent on the robustness of your implementation.
3 Likes
Just my 2 cents but when I do this with a little of calculation for analytics it will timeout or stop randomly
Sounds odd, you may have a lingering issue.
Either too many workflows are being executed in // vs. the available capacity, or a data issue.
1 Like
Agreeing 100% with @redvivi !
1 Like
I just moved my processes over to a MySQL database.
I was doing a nightly process that would make several hundred API calls and then store that in a database. When using the Bubble DB, I had issues with duplicate records being created but the main issue was the app hitting capacity and timing out.
I recently rewrote my process to send an executable string to a MySQL database and that kicks off a Stored Procedure that inserts it into the table. I am also using a Stored Procedure to pass one record to Bubble, mark it as processed in DB, then do XYZ to it.
Granted, my process does not involve payments… if it did I would want to make sure I had a good logging table.
1 Like
What plan are you on? Above Personal?
It was implemented on a Professional plan.
Hi, could you specify how are your backup workflows?
I would like to know how this backup workflow works (if it’s the same as the other or not)
I also would like to know how your flow alert you if the certain number isn’t reach.
By the way, I’ve watched your video on youtube " Bubble Tutorial: Create a List of Things", I guess that’s how you create the entries, right?
yes, thats how i create things.
i have a backend workflow that starts the one that creates things, it records every time its last run time and saves it
the backup workflow restarts the above, if the above has not run in the last 30 minutes, using the “last run time” field.
1 Like
Cool, but I didn’t understand how it records the “last run time”?
Like,
API workflow → create thing → Change database (last time run) → schedule API current time?
