Updated Product Feed

Need help Database
1

Hi,
Could someone please briefly provide with the best approach to deal with constant updated product feed?

Meaning that we are looking to scrape product feeds from different clothing websites and via API feed it to bubble. The script would give different time frames (i.e daily) so that we could provide the most recent product information and remove the ones are outdated or removed by the website owner.

What could be the best way to handle all this large incoming data.

Thank you in advance for any advice.

2

If you have an API you don’t need to keep the data in your Bubble database, you simply ‘call’ the data when you need it…so if a user is loading your search page to see the products, that is when your API will be ‘called’ and you would be able to display the updated products as your api would receive what is in the database of the api provider.