I discuss common problems I've seen when it comes to distributed training, provide general tips, and talk about cool things I've found that week.