Processing of multiple files and concatenated results

[Admin]

@Olaf

By the way out of the other discussions about resource use I will try to change the interim file from Excel to another format

I ran some test and Excel is really slow compared to delimited text.

Performance reading/writing tabular file formats

Reading and writing the same 500,000 rows x 14 columns in different formats on a Mac M1 Air using Easy Data Transform v1.43.0: Format Read (seconds) Write (seconds) Tab Separated Value (unquoted) 1.203 0.516 Comma Separated Value (quoted) 1.980 0.870 Excel XLSX 30.314 31.302 So tab separated without quoting is the best choice for performance, as long as your data doesn’t contain tabs. And Excel is much slower than either comma or tab delimited.