Distributed training with ray and torch

[SarahAlidoost]

We can use ray + torch to distribute training on multi nodes, see https://docs.pytorch.org/tutorials/beginner/distributed_training_with_ray_tutorial.html#scaling-to-a-multi-node-cluster