@sacoetzee You can run the non-streaming action as a backend workflow, yep.
2 Likes
Sorry, but then what do I set as the Data Container ID in the non-streaming (fallback) action?
Hi all,
Another question here (no rush with the answer).
Each time I send a message I’m sending:
- User messages (1 + 2 + 3)
- System message
- Message history (the last 8 messages of the chat).
Is that correct? Thanks!
@sacoetzee - you can just set it to the data containers ID, or a random string. I think both will work, but let me know if not
Mostly, yep. Each message from 1-3 gets added, and the system message, if set through the Set System Message action.
The only thing that’s not accurate is “the last 8 messages”. The plugin sends all previous messages, up to the Input Limit. If you don’t set the Max Input Tokens, it will be set to half the model’s context limit (eg half of 4096 tokens for 3.5), and the plugin will use as many recent messages as can fit into that window. If you bump it up, say to 4000 tokens, then the response will be limited to the remaining 96 tokens.
Hope that makes sense!
1 Like
Makes sense.
I’ll test what’s the best combination in terms of speed & response quality.
Thanks!
Hello, @launchable Sorry if this question has been asked before, but how can we “reset” the history of the data container? And how can we make sure that the history of a container for User A is not seen by the same container for User B?
Thanks the random string does work. But the the “non-streaming (fallback)” action doesn’t seem to have the same fields to execute a function call as the “Send Message w/server action”? I have tried to place an “execute function call” action in the workflow after the “non-streaming (fallback)” but it’s not using it? I assume cause its not being triggered to by the “non-streaming (fallback)”?
@Guillaume.b - you can run Clear Message History on the data container.
re: the history for different users, if you mean users on different computers, they won’t; that data is stored on the page. If you mean something else, please let me know and I’ll try to clarify.
@sacoetzee - ah, that’s a good catch. Function calling isn’t implemented atm for the non-streaming workflow. I’ll add this to version 6 though. Thanks for bringing it to my attention 
1 Like
Ok all clear now. Thanks! When will V6 be released? Will you have “easy tutorials” to understand how to set up the new features! Keep up the great work. It s amazing
@Guillaume.b - it should be released early next week. It’s finally all done.
Next week I’ll be making a bunch of tutorials and documentation, yeah, which will help with getting started, especially with the more advanced setups and new features.
1 Like
Great timing! This coming thursday I head halfway across the country to present my SaaS at an event, and I’d love to have these new features by the time the event is over that weekend!
2 Likes
Hey there
Was wondering if this is ready? And also is there any documentation on how to do function calling advanced functions?
1 Like
Hey @enbitious
Working on publishing it now. There’s a bug somewhere, either in the plugin publishing system or in the plugin itself, that’s stopping it from being published, so I’m talking with Bubble to resolve it. It’s all done and submitted, so hopefully should be available soon!
2 Likes
Hello @launchable, I purchased your plugin today. Firstly, thanks for the great work & taking good care of user requests.
I’m adding it to my site rn but running into a problem. When I try to call the plugin on page load it doesn’t seem to work. Only when I put the action behind a button (same page) it calls the API.
Any idea what I’m missing here?
Many thanks!
Hey @awild.wiinfo - thanks for the support!
I’m not sure what’s causing your issue off the top of my head. Are you trying to display the response on page, and not seeing anything?
It’s possible the action is running before the container is initialized.
Have you tried loading the page in debug mode, with step by step turned on? That shouldn’t give you an indication of whether the container ID and connection info are set,
To be honest, I haven’t tested sending a message on page load, aside from using that idea to “prime” the action. I’ll be curious to see if we can get it working. Also, I’m quite confident it will work with v6 once I can release it, as it’s built differently.
Thanks for the prompt response.
When I run it in step-by-step debug mode I can see that the Container ID is set but not the connection info.
But this seems also to be the case when I run the action by clicking the button:
Thank you! Because I still see in the current version there is repetitive words here and there.
Hello. Do you think it will still be released this week?