OpenAI plugin timeout question

Ask us anything
1

I’m using the OpenAI plugin in WeWeb. When I use a short prompt, and short text generation, everything works.

However, I’d like to use a prompt that generates about 1,000 words of text, and it takes up to 2 minutes for the model to generate that in the Playground on openai.com (can be less depending on how heavy their traffic is).

When I use that longer prompt in the WeWeb OpenAI plugin, I experience a 504 timeout error.

Any ideas on how to fix? Can I set a timeout on the plugin call?

2

For those reading later on… I solved this by running the API call to OpenAI server-side, and connecting that up on WeWeb via a Collection fetch to the endpoint.

The server call works because I was able to extend the time-out there sufficiently for the response to complete from OpenAI. :clap:

2 Likes