Picking up one topic of the Pane Layout discussion (Alternative Pane Layouts), were Logging information is mentioned.
I use batch processing massively and process often larger numbers of files selected with “*”. Sometimes I struggle with the logging information as the processing is so fats, that you don’t see what is stated in the logging window space. There is no real summarized information in the window. At the end it just state the complete batch has used (here) 0.532 seconds, but there is no information how many files are read, if there were errors, etc. The log file has the same structure as the information in the window.
Is it possible to extend the output in V2 with a summary about correct processes and errors. When it shows errors it is possible to find them with the information given, but normally I don’t scroll though the log information, specially when high number of files are processed.
In v2 batch processing now reports:
-any errors from transforms (such as severity=error verification fails)
-displays the total number of errors at the end
looks fine. It would be good to have a note about the number of input files processed, too. Often I know there should be x files be processed, but I’m not certain if read and covered completely, number output files might be dependent on decisions in the processing logic. In case of multiple input files it would be counted per Alias, this would inform on one view if all expected files are processed.
I’m not clear with the “Attempt to overwrite” message. This will come up if one batch job overwrites the same file? Is the “overwrite” blocked and only the first version of the output file exists or is it overwritten and the last version is stored?
It is tricky as the same input file might be read multiple times, even in the same .transform file. I could just log the number of inputs read. But I don’t know it would be helpful to categorize this by alias.
Previously it told you how many times it had tried to overwrite an existing file. But this was a bit confusing. So it now only flags files it has tried to overwrite more than once during batch processing (which is probably an error).
I think it covers all information occurring in batch processing. It shows, the numbers of runs of the .transform file, the number of files read and written per alias. And as before errors are shown, so that an analyse of the complete message chain can be done to find the more detailed error message.
Now I can clearly see with the last line, there are issues (this was available before). But now I have a clear first indication for what to look.
In this case I see it was execute 10 times and I had 10 main input files (with 2 additional templates for Stack sorts ,). It shows the issue is in the main file with Alias “TC_Sheet” as it is read only 7 times. And I know in general the file selection with the “*” see all files.
Further analysis is now much easier. In this case it was a naming of the tab in the Excel-Sheet.
Thank you Andy for adding the additional information.
