Just a quick note to let you know I’ve made a minor update to my “Fixed Width Text File Toolkit” repo on GitHub.
If someone combined a bunch of fixed width text files (e.g. jan2010.txt, feb2010.txt, etc.) together into one big file (e.g. 2010.txt), that big file would have a series of header rows repeating throughout the data. Granted, it’s an edge case, but it isn’t completely impossible.
This update makes the FWTF Toolkit “smart enough” to recognize a header row when it is repeated in the middle of the data, and ignore it automatically behind the scenes. No configuration required, and it has surprisingly little impact on peformance.