Forum Academy Marketplace Showcase Pricing Features

[FREE PLUGIN] AI Proxy - ChatGPT, OpenAI, Claude, LlaMA, PaLM Real-Time Streaming

Introducing the ultimate tool for no-code developers! “AI Proxy - ChatGPT with Real-Time Streaming” offers unparalleled access to ChatGPT, OpenAI, Claude, LlaMA, PaLM and its standout feature is its flexibility: you can pass ANY option that OpenAI supports. Tailor your AI experience like never before! :hammer_and_wrench::sparkles:

Plugin url: AI Proxy - ChatGPT Streaming Plugin | Bubble

Tutorial:

Key Features:

:pushpin: Complete Customizability: Specify your own JSON to send to the AI

:rocket: Real-Time Responses: Experience fast and fluid conversations without delays.

:bar_chart: Token Counter: Monitor your usage transparently.

Discover AI’s Full Spectrum:

:left_speech_bubble: Craft perfect chatbots or support tools.

:question: Implement rapid-response systems for diverse queries.

:writing_hand: Generate diverse content, from tales to tweets.

:heavy_check_mark: Check facts and verify data with pinpoint accuracy.

:bulb: Navigate intricate thought chains with ease.
…and so much more, limited only by your imagination! :stars:

“AI Proxy - ChatGPT with Real-Time Streaming” is where no-coding simplicity meets infinite possibilities. Dive in and redefine your AI interactions! :rocket::star2:

Models supported:

  • OpenAI: GPT-3.5 Turbo openai/gpt-3.5-turbo (using OpenAI or OpenRouter.ai)
  • OpenAI: GPT-3.5 Turbo 16k openai/gpt-3.5-turbo-16k (using OpenAI or OpenRouter.ai)
  • OpenAI: GPT-4 openai/gpt-4 (using OpenAI or OpenRouter.ai)
  • OpenAI: GPT-4 32k openai/gpt-4-32k (using OpenAI or OpenRouter.ai)
  • Anthropic: Claude v2 anthropic/claude-2 (using OpenRouter.ai)
  • Anthropic: Claude Instant v1 anthropic/claude-instant-v1 (using OpenRouter.ai)
  • Google: PaLM 2 Bison google/palm-2-chat-bison (using OpenRouter.ai)
  • Google: PaLM 2 Bison (Code Chat) google/palm-2-codechat-bison (using OpenRouter.ai)
  • Meta: Llama v2 13B Chat (beta) meta-llama/llama-2-13b-chat (using OpenRouter.ai)
  • Meta: Llama v2 70B Chat (beta) meta-llama/llama-2-70b-chat (using OpenRouter.ai)
  • Nous: Hermes Llama2 13B (beta) nousresearch/nous-hermes-llama2-13b (using OpenRouter.ai)

Sponsored by CoAlias

Instructions

  1. Go to https://nocodesaastoolbox.com/

  2. Login with your emailadres. You will get a email with a link to login.

  3. Click on Add app. Add your app url like https://bubble.io/ and press Add.

  4. Click on Show Client ID & Secret. Fill in your Client ID and Client Secret into the plugin.

Check the app to see how it works: AI Proxy - ChatGPT Streaming - Sample

Check the editor for a sample: ai-proxy-sample | Bubble Editor

I would love to get feedback to improve the plugin! Working on making generating OpenAI requests easier, better error handling and usage statistics.

11 Likes

Looks great! Does this support function calling?

Yes. All current and future options. Just specify what you like in the json request.

ab the legend!!

1 Like

This is awesome Ab! :rocket:

1 Like

Free? Hmm, you may be selling your services short there, Ab. The other ChatGPT real-time streaming plugin that has been bumped to the top of the forum constantly over the past 4 months is $200 a pop or $20/month. You gotta get some of that sweet streamin’ money, Ab! :slight_smile:

6 Likes

Happy if people like it and use my other product (coalias) :wink:

6 Likes

Plugin looks great! And free?!

But there doesn’t really seem to be much (any) documentation. Of course that’s forgivable if it’s free but a little bit of info would go a long way.

Here for example:
CleanShot 2023-08-12 at 15.40.51@2x
What’s ‘request’? Is that a normal OpenAI request body? I tried that and got an error {“error”:“Illegal base64url string!”}

I tried the same with the AI Request action and same result (and I don’t know if and how AI request is different to start stream - do I make an AI request and then start the stream? Do I just use the start stream? Is AI request for non-streamed responses?)

Please realise this isn’t a criticism at all, I just want to work out how to use it because it sounds great!

1 Like

Looks great, would love to see a demo and a way to make the key dynamic for bring your own key style apps.

1 Like

Ill upload a demo in a couple of hours. The editor has a working example btw!

1 Like

Good feedback! Ill add a option for that as well.

Where’s the link for the editor! Can’t wait to try this.

What’s the editor link? I can’t find it here or in the plugin page :slight_smile:

1 Like

Neither!

3 Likes

Isn’t working, coming up with an error.

Ill upload a video to show how it works. It still bit rough around the edges. Need to add better error handling and errors.

You didnt follow the instructions to add the client id and client secret

Okay sweet, looking forwards to trying it, cheers Ab