I am looking to split a very large XML file for which I've already parsed the data individual records of three different types.
I want to split each of those three sets of records into a dynamic number of chunks so as to only have (for example) 1000 records in each chunk. I won't have any idea how many records are in the original files though, so I would have to calculate the number of chunks dynamically. The Partition component doesn't appear to let me chunk based on # of records, just on a range of values or a particular partition key, neither of which works for this scenario.
Additionally, if I don't know how many output ports there will be, how do I bind the output to a writer?
Thanks in advance,