[New feature] Native support for API streaming

[justin.j]

You want to be displaying the data in your RG cell from a group with the “text stream” datatype, then once the stream is done, write to the DB. You can’t stream to the DB directly, and if you could it would be a lot of workload units.

Check this out

LLM streaming in repeating group

This is how I approached it with my workflow after the user hits submit on the chat. First thing you need is a group on the page to act as the “Stream Handler” with a data type of “Text Stream” "Create a new message" or however you’re populating the RG (You might need additional workflows here to populate the RG with this message, depends on how your DB is set up) I call the OpenAI API “Display data in a group/popup” with the “Stream Handler” as the group populating it with Result of Step 2's …