Partial updates while request is ongoing - Any best practice?

Ask us anything How do I?
1

Hi everyone,

I have a use case and am looking for best practices.

I’ve built a form to upload a CSV file and send the data to Xano. Xano then calls the OpenAI API to enrich some of the data, which is taking a considerable amount of time to process the entire file. This can be frustrating for users if they can’t see the progress of the processing.

I’m exploring ways to provide users with visibility into the processing status. One idea is to create a table in Xano to store the request events and track the number of items processed. I could then periodically fetch updates from this table in WeWeb. However, I’m concerned this isn’t the most efficient solution, as it would involve sending requests to Xano regularly, even if no new records have been processed.

Ideally, I want to include a function in Xano’s loop that executes every time a new record is processed and pushes the data directly to WeWeb, rather than having WeWeb repeatedly pull data from Xano.

Does anyone have any suggestions or ideas on how to achieve this?

Thanks in advance!

2

It’s fine to do it like this, it’s actually called polling, just don’t overdo it and add guardrails, such as if there is an incomplete request, do poll, otherwise don’t poll. Or just use realtime.

3

Thanks for your reply @Broberto !