GPT-3 - Tracking Tokens Used by End Users

Hi, fellow bubbles.

Would like to know how do you deal with the limiting the usage of GPT-3 by your end-users?

I am planning to assign to each end users a fixed amount of token per month, thereby capping their use of GPT-3 to a certain limit but I do not know how. Has anyone done it before? Or is there a better way to do it?

Would be grateful even if some one can point me in the right direction.

Muchas gracias!

Bump*

Hey, where you able to figure it out? - Im looking for the same thing :slight_smile:

I haven’t built this specific thing, but at a high level it is likely akin to

On User Action (e.g. click a button)
Current User’s credit balance minus 1
or make it dynamic instead of hard coding minus 1: minus things cost

Allotted Credits: Store in the DB (probably a separate datatype tied to the user)

  • Schedule a monthly workflow to reset the user’s credits.

Dynamic Cost: Can be stored in the DB or as an Option Set - then you can have multiple varying costs with easy means of updating them without searching your workflows for something you hardcoded

2 Likes

Thanks, that gives me the perfect starting point <3

no problem!