According to Penn Medicine, physical activity such as yoga, walking, or any other activity that gets the body moving can help ease joint pain. Over-the-counter pain medication also helps with pain, but your best bet is to keep stretching and moving, especially since the joint pain one experiences in the rain can still happen in any climate.