Need Help with High-Volume Data Handling and Caching in Bubble

you can do this in a few different ways but it depends on if the data is changing at all.

If the data is not going to change at all, or so infrequently that it is no problem to do some manual intervention, check out this reply where I break down steps for another user to upload a large JSON file and use it via the API connector as the datasource.

If the data is going to change somewhat in such a way or as often that you want to be able to make the entire process easier, check out my plugin Data Jedi.

Data Jedi

Purpose built to handle frequent searching of large lists of data with results of 95% less WU consumption and 30-50% content download speed improvement…so you get faster load times at a fraction of the WU costs.

I built it as I need to search large data sets often and did not want to migrate or utilize some 3rd party database. It also has local storage functions, a searchbox element (lets you search any data type and any field or multiple fields at once), it has a paginator element, thing in list element (finds item in list and the item before and after), plus a breadcrumb element…there is some more, and it has a ton of other benefits. Will be adding in more elements over time.