Push large (1GB or larger) files to my Bubble.io app's file storage?

Questions
1

Hi,

I understand that the file size limit of the /fileupload endpoint is still 50MB. :frowning: Will that change anytime soon?

Secondly, given that limit, is there any way to upload a file larger than 50MB to the Bubble file storage NOT using the file uploader UI element?

Specifically I have an AWS Lambda function that generates a video file around 1GB, and I would like to push this to my Bubble app’s file storage. (I know I could push to my own S3, but in this case I would need to/like to have the file be in my Bubble app’s file storage.

How can I achieve this? :frowning:

Thanks!
Steve

2

From what I know, you can allow large file upload in plugin element. So you can build your own file uploader.

1 Like
3

filestack is good for this

also uploadcare

1 Like
4

The stock Bubble.io file uploader now allows file uploads theoretically upto 5GB, but in reality browsers limit this to about 2GB. My problem is that I would need a way to upload large (>50MB and <1GB) files to Bubble’s file storage from an external source (an AWS Lambda function). I tried using Bubble’s /fileupload endpoint, but that still has a 50MB limit, so if I try to push anything larger than that, it comes back with “entity too large”. I also tried to create an API Workflow to download files and try to save them via an API call, but that also has a 50MB limit.

I am trying to figure out why /fileupload is limited to 50MB is the file uploader UI element IS now capable of larger than 50MB uploads. :frowning:

I find Bubble’s own file storage more convenient than having to create an S3 bucket of my own and implement signed URLs and security. Whereas if my files live directly in Bubble’s (also AWS) file storage, security is conveniently taken care of.

So I am looking for some way to get a file from AWS S3 (or AWS Lambda function temp file) to Bubble’s file storage, without using a file uploader UI element.

5

Thanks! But they both also only work to help with UI-based file uploads, no? What I am looking for is to be able to “push” a file from AWS S3 to Bubble file storage, programatically. Basically a video is converted by an AWS Lambda function, and I woudl like to save the resulting mp4 file to Bubble’s file storage. So the Lambda function would need to be able to save it to Bubble file storage somehow. Bubble does have the /fileupload endpoint (not really documented), but that only accepts 50MB files. The new file uploader UI element can do up to 5GB (theoretically), and that uploads to /fileupload/getUrl (I think), but not sure that can be used from an external source. Waaaaah! :frowning:

6

be best to just store everything in s3 and configure bubble to reference the s3 files

much cheaper
fairly simple setup

mux would be the best way to serve the video also

1 Like
7

Thanks! But my issue with that is the complexity it adds in terms of managing file access rights. If stored under the Bubble umbrella, then access rights could be controlled nicely from within Bubble very easily. If I store my files on S3, everything becomes a bit more of a pain to manage. :frowning:

It is frustrating that the file uploader element allows large files, but for some reason there is no API/endpoint to allow Bubble to “ingest” similarly large files without GUI.

8

doesn’t add much extra access rights complexity

just create a data for “files” then use that to manage the access like you would any other data in bubble using the privacy settings

1 Like
9

Thanks! I will follow your advice. I also decided to use Zeroqode’s AWS File Upload plugin, which makes it all easier. I think this will be fine. I already have the File data type (“database table”) set up anyway, so I can just expand the way I use that to keep track of access. Thanks!