HDF5 file data order is assumed

[mfe5003]

The server saves data to the HDF5 file in the order it was received, but assumes that the data is received in the order according to the timestamps. This may not be a valid assumption in all cases especially if there is some network jitter on a high bandwidth connection.

[mfe5003]

A possible light weight solution is to have a "data sorter" operation that is part of the buffer transfer to long term storage. When a new chunk is ready the storage is incremented by a chunksize and then a separate thread takes the whole chunk that was just completed, sorts it, then stores it in the new slot. If it a separate thread then new data could be stored as the sorting and compression was happening.