Would like to know how do you deal with the limiting the usage of GPT-3 by your end-users?
I am planning to assign to each end users a fixed amount of token per month, thereby capping their use of GPT-3 to a certain limit but I do not know how. Has anyone done it before? Or is there a better way to do it?
Would be grateful even if some one can point me in the right direction.
I haven’t built this specific thing, but at a high level it is likely akin to
On User Action (e.g. click a button)
Current User’s credit balance minus 1
or make it dynamic instead of hard coding minus 1: minus things cost
Allotted Credits: Store in the DB (probably a separate datatype tied to the user)
Schedule a monthly workflow to reset the user’s credits.
Dynamic Cost: Can be stored in the DB or as an Option Set - then you can have multiple varying costs with easy means of updating them without searching your workflows for something you hardcoded