We just rolled out an overhaul to the CSV data exporting feature, which paid users can see in the Data > App Data panel of the editor.
Key highlights:
No more 20k row limitation (should work on just about any table)
The export is now done server-side, and the editor remains fully useable during the export
When the export is complete, we will send an email to you with a link to it
The result file will appear in your files as a private file only visible to users with editor access
You can make several exports at once
New file export format options: csv, json, and ndjson (newline-delimited JSON)
A lot faster for simpler views!
You can see exports in-flight and can cancel any there
Tips and gotchas:
Behind the scenes, we export in batches that we stitch together: this means that rows deleted during an in-flight export may still end up in the export if a previous batch exported them already
Don’t edit a data view during an export of that view! For the reason stated above, weird things may happen
A view where columns contain data from other tables will be a lot slower to export than a table with only self-contained data. If you want the best possible speed, set all “primary fields” that appear in a given view to be unique ids.
Hope you like it, and be sure to report any problems you encounter with it!
Anyone else having trouble on nearly a big percentage of exports? Out of 22 attempts, 12 have failed. Granted, the bases are pretty large (field wise) and there’s linked fields, but the previous exporting structured was able to handle it…
Operations that have a lot of linked fields will use a lot of capacity, and as a protection measure we throttle the operation to avoid an app from burning through all the capacity too quickly. This did cause some large exports to fail so I’ve pushed a fix to dial back this throttling a bit, which should address the operation’s reliability on your end.
Don’t hesitate to tell me if this is still broken, however you will indeed experience variable performance depending on your app’s available capacity
Just rolled out the feature completely, which means we removed the option to use the legacy client-side export.
Keep in mind that the exported file will always be available for you to download from the file manager tab as soon as the progress hits 100% for the exported file and disappears ; you don’t have to open your email.
Best,
For reasons unknown to me, all dates on your CSV exports are in Vietnamese and I can’t find a way to fix it. P.S., I’m from California (NOT VIETNAM).