I had a decent heavy transformation , where I had to add a column in one of the starting files (poheader) , I was dreading It , considering how much re-work I have to do in joins and lookups.
I was surprised with V2 , all my joins , lookups very preserved downstream inspite of adding columns !!
I want to second that. Downstream stability to changes is massively improved and thatâs very helpful!
There is one thing that could be improved from my point of view⌠if you add a âNew Colâ transform before any âRemove Colsâ, the new col will be marked removed in all following âRemove Colsâ transforms⌠I think it is pretty obvious that a column added later should be present, not removed
I think there are situations where this wonât be the right choice. So it should probably be configurable.
It is on the wishlist to have an option in Remove Cols as to whether any columns added upstream should be checked or unchecked (currently they are unchecked, so not propagated).