-
Notifications
You must be signed in to change notification settings - Fork 6
Chunking Large Files
Eric Jahn edited this page Jan 3, 2014
·
2 revisions
- A single exported file may be difficult to send or process by the receiving system. To resolve this problem, the large file may be split into many exports.
- A given id may not be within the same chunk, so the receiving system must first assemble all the chunks into a database, or in memory (or at least the indexes of the chunks), in order to effectively look things up within the various chunks.
- How does the sending system declare the number of chunks the receiving system can expect? Either an initial transmission/response, or it could be an element within the XML, or both. What kind of communication will occur if the sender said 5 chunks will be sent, but then the receiving system only gets 4? Perhaps an error code/message for this.