Not so sure about that , sure for Convolution which is the FOTM but many other network are more difficult, extending the C++ of tensor flow is difficult. eg try implement drop connect in Tensor flow.