I’ve noticed OpenAI calls for lists (as the output) seem to be a lot slower lately. Aso, it seems the more list items requested, the slower the response.
I have an application where I would like a list of 10 (that is the right size for my application) and users choose among the list generated.
Please advise thoughts on how to speed up this process. I can think of the obvious. Reduce the list size (not ideal) and try to simplify the request (albeit the request is fairly simple now).
What am I missing?