Looks like TensorboardX supports writing to S3 and TB itself natively supports writing to S3 (anyone tried GCS?).
I am not sure whether the PyTorch writer supports S3, but judging by these threads (1 and 2) it should work if you handle your ENV variables properly:
The torch.utils.tensorboard implementation uses a writer in core TensorBoard that supports GCS and S3 if TF is installed and S3 if not installed.I did not know this, this is very cool!
#deep_learning