CNTK has added support for Multi GPU and CNTK Performance has improved significantly over TensorFlow, Theano, Torch and Caffe.

[vickylance]

Please see the below linked chart for details on my claims.

https://github.com/Microsoft/CNTK/blob/master/Documentation/Documents/PerformanceChart.png

Thanks.