Nvidia working hard to make 3D render based on neural networks. See their new paper https://nvlabs.github.io/wc-vid2vid/