Issue exporting large list of records (2.5 millions)

Feature(s) impacted

Dashboard export

Observed behavior

When attempting to export 2.5 million records from the Dashboard using Actions > Export ad impressions, I encounter console errors and the export is never completed.

Expected behavior

The export should work. I should be able to download a CSV file with the records.

Failure Logs

Context

  • Project name: La langue francaise
  • Team name: Operations
  • Environment name: Production
  • Database type: Postgresql
  • Recent changes made on your end if any: NA

And, if you are self-hosting your agent:

  • Agent technology: (nodejs, php, ruby, python) ruby / ruby on rails
  • Agent (forest package) name & version (from your .lock file): gem “forest_liana”, “9.14.4”

Update: after trying again, it worked this time.

Maybe add the process in the background and send an email to the user when the download is ready?

Hello @nico_lrx

Thanks for the feedback and update on this.
As the export you attempted concerned the data present in your database, everything is done on your agent, you would have to look at the logs to understand what happened.

Sadly as of now, the export is done synchronously. A workaround to improve the “success rate” would be to do it by batch using filters by date.

Hope this can be helpful,

Best regards,