Check feasibility of Threading

[ayush-khandelwal93]

Dumping the key-value pair from dictionary to disk has been done by creating a new thread from main thread. However, since the process is running on a single core and only one thread can be run concurrently, it is as good as dumping it to disk from the main thread.

If however, making of a new thread is replaced by a new process using fork, this might be of help while writing to disk. This is because the new process(child) will have the task of dumping the key value to disk, meanwhile the parent process would continue to run alongside. This will ensure consistency as even if the parent process crashes due to some errors, the child process will ensure that the key-value pair is written to the disk and is always consistent.

This consistency issue is not taken care by multi-threading because if the process crashes due to some errors, all the threads of the process will be killed and the key-value may might not be completely written to disk, making the disk inconsistent.

@shril Please let me know your thoughts.

[shril]

Excellent observation @thegaribguy but how do you plan to execute multiple processes on a single core machine?

[ayush-khandelwal93]

Yaa @shril , but I would say running multiple processes on a single core is solely the job of the Operating system. What we can do here is make a child process using fork() and give the responsibility of dumping key-value pair to the child process. The operating system will make sure that the child process would be executed irrespective of the parent process. Hope this makes sense.

Let me know your thoughts on this and we can discuss more if required.

[shril]

We will pick up this issue once we are done with the documentation.