Fresh lib for PyTorch from Facebook that can help you with large scale parallel trainingshttps://github.com/facebookresearch/fairscale
