We’d like to integrate OpenRouter into our app. Since there’s only one OpenRouter streaming plugin with no ratings yet (which also uses the new streaming method from the API connector), we’d like to set it up ourselves, but we need it to be stable from the start.
What are the known bugs using the streaming from Bubble and can we trust it to work well already for our paying users?
I use Cloudflare’s AI gateway (similar to OpenRouter) and just call it through my Worker using the API Connector. No issues so far, though I haven’t needed to stream responses back to Bubble.
Your best bet is to just spend a few cents to test out a setup.
Yeah I did. We’re using pretty large prompts and outputs and it seems like the timeout makes it unusable for us
@ihsanzainal84 curious why you chose Cloudflare’s AI gateway by the way 
Mainly because the bulk of my backend stack relies on Cloudflare’s services and they speak to each other constantly.
Overall I just like how Cloudflare ties all their services with Workers. Makes troubleshooting easier since it all starts from a call to one.
Yeah the timeouts are because of Bubble’s restrictions for calls. I’m not familiar with OpenRouter but what you could do is to get the response to be sent via webhook. Though not sure how it will work for streaming
Cloudflare’s AI Gateway does support websockets so you could try that.
