Plan B - you can off site your data to EU or US AWS Buckets, as CSV files (on the back of the Bubble Data API). You can schedule that to be automatic daily.
And it’s not quite there yet - but I’ve something in the works to overcome the 50k limit. I’ve been trying a few different things and think I’ve got an approach that works.
I’d think if everyone created a BE workflow to do the paginated data vs hitting the data api you could pull this off.
Not as easy/friendly to use with this method but should allow you to get any records, regardless of count.
Sadly not true, Jared - can confirm that backend workflows have the same 50k limitation as fetching from the data API. That said, @lindsay_knowcode, did you have a chance to look at my Python code from a year ago? It overcomes the 50k limit!
this is a smart approach! nice!
Nice! Figured I’d ask as it sounded like you were still trying to implement something similar. Was my code missing something?
I use the date similarly - but with Node lambdas …