Can weweb add a reasonable way to stream data via an api call?

Ask us anything
1

Hello,

Can weweb add an reasonable way to stream data via an api call?

Thanks,

Ed

2

Hi @edpred, what’s your usecase ?

3

Hello @Alexis I need to make a call to an llm api (not openai but supports streaming) and have it stream back into weweb. Basically, a chatgpt clone with custom models. Do you support streaming and how would I make that happen?

4

With a javascript action you can perform anything, it depends of the API available in front of your LLM

5

How would you implement the streaming into a variable? Right now I am not able to get it to return anything via the javascript plugin, but can stream normally with postman.

6

It depends of the API you have, where is the documentation ?
What do you do with Postman ? Which are the settings ?

7

you can also with variable like StreamOutput that is a variable array
need to try really with only REST API plugin, but with OpenAI plugin no issue to do it