If you split your original file into chunks, how can they take more space than the original one? I know there's a bit of overhead in writing individual files but that should only make a marginal difference.
In addition, why wait until all chunks have been created before you start processing them? If you do that simultaneously, the files will disappear as they are being processed.
I think I'm missing a bit of information because I don't understand how this could be an issue.
_________________________
Technical Product Manager
I don't want to achieve immortality through my work; I want to achieve immortality through not dying - Woody Allen