So I have 4.6 million files I need to upload to the database. Each file is simply a text file that’s about 1kb. But the dataset is over 4GB.
I will need to do searches on these such as, does the file’s text contain “first name last name”
Anything I need to know and any advice?
You’ll pay more in bubble fees on those than you would if you paid someone to get that data on a cloud provider and you search and use it that way.
That’s my advice.
Should be fine, that’s just 1000 letters per file…
To upload, create a BE workflow API endpoint and call that repeatedly from a local script with your data, or use the bulk create API to do the same with your data.
Yeah there’ll be a cost of 0.5 per thing, or more depending on the method used, so estimate 2.5 million WU, you can work out the costs
Please have a good long think about the cost of doing this in Bubble. 
(Please)
If its public data - consider Algolia or something like it. If it’s private consider any of the numerous DB alternatives especially designed for this kind of thing. 
