I chose the ffi node module to focus on the bigger picture.
It should be pretty straightforward however to use node-gyp and create a custom binding layer for exposing TensorFlow functionality into node.js -- effectively recreate, so its not going through generic layers and incurring overhead.
However, the interesting question is what is the overhead and does it matter? Need to determine that before taking this on, when enough stuff works, and it can be considered.