I carry a small cross-body-organizer that includes compartments for credit cards and cash, and two zip pockets. One I use for makeup, keys, and sunglasses, and I place my change in the other. My cell phone fits in an outside sleeve where it is easily accessible. When I travel, I toss my purse in my tote to use at my destination.
You can find organizer bags starting for twenty dollars and up at Macy’s, but spending more may ensure that they last longer. Two bags that I recommend are Brighton, that you can purchase at Kokopelli or you can order it online, and the other is a Brahmin. Both wear well.
In the past, I had carried a large bag, but I have found that these organizers are convenient. Though I had bought them for travel, I use them daily.