I’m trying to build a personal finance app using bubble and wondering what’s the best way to structure my application. Basically, I need a user to authenticate their bank account (Plaid) and to show them aggregations of their transactions data (not the raw data) . So here is the problem, where/how can I do complex data transformations?
My intuition says to build an external web app that exposes an API that can fetch data from Plaid and send aggregated data bubble for displaying it to the user.
What are other ways to do ETLs/Data transformations with bubble apps?
This is what I’m thinking of, but if it’s possible to do this in a more simple way, I’d love to hear it.
Yes, that get me 50% of the way there. It serves back line by line transactions from the Plaid API. From there I want to do complex data aggregations and transformations, like say calculate the money spent on Uber or Amazon over a time interval. I don’t think bubble is great for these ETL jobs, but I might be wrong. This is why in exploring building a web API that can pull/store/transform data to be served in a clean way to bubble… Thoughts?
I am not sure if you have seen this thread yet or not:
But you could potentially group data using this feature. I am not sure, whether you are currently saving the information after fetching in the Bubble DB or trying to process it directly. You might need to see how best you could implement it, but just want to highlight this capability.
Otherwise, ofcourse, you could always do all this processing somewhere else and then just fetch the processed data into Bubble.
Okay, this is good to know. I hadn’t thought about it this way. Thank you John!
@stanleychris2 check out https://parabola.io. I was recently introduced to it and was really impressed with their data transformation functions. Seems like that’s their thing and you can import data from API endpoints (e.g. Bubble Data API or some other External API, hopefully Plaid for you) and export results to an API Endpoint (e.g. Bubble Workflow API).
I’m going to do a tutorial on using it with Bubble soon, but your post really hit the use case - might be exactly what you’re looking for.
Edit: The one thing I hope they add is real-time runs of the workflows like webhooks. At best, looks like you can schedule the flows to run every 10 min.