I tend to wear leggings (or capri leggings) since four days a week I'm either doing Pilates or strength training. I'm not one to sweat much unless I'm outside in heat walking/hiking, so what I put on before a workout can stay on me until bedtime. I have a couple of pairs of joggers, but don't seem to wear them as much. I feel like the leggings give me a more slim look (although slim is not how anyone would describe me). I know there are some cute joggers out there, I just like the feeling of leggings better. And I do see other women out there in my age group who wear them, and I think they're fine. But you should wear whatever is most comfortable for you. In that vain, this is what I've found for my own personal experience...
I also like Athleta, although I wish they had more leggings with pockets. I do have a couple of pair of their fleece leggings/tights that I pretty much live in during the worst of the winter months, although I don't work out in them. A couple of pair of my fleece tights came from LL Bean - I just wish they made them without the reflective striping.
In the last couple of years, I have bought several pairs of the Beyond Yoga Spaced Out of Pocket midi legging. They are absolutely the softest legging I've ever found. When we lived in LA, I could visit their flagship store to actually put my hands on the fabric and try stuff on to see how their sizing works for me. But their only brick and mortar stores are in CA (and a new one in the Seattle area).
WRT the joggers I wear, I love Outdoor Voices CloudKnit line. Again, they're the softest I've ever found. I know a lot of people swear by Vuori, but I think the CloudKnit line is way more comfortable. Again, for me, it must have pockets, and pockets deep enough to hold my phone. If I think about it, in a pinch my Beyond Yoga, Athleta and Outdoor Voices bottoms that I have with pockets, in a pinch, can also hold my water bottle. So that's a plus for me.
I've been in Dick's Sporting Goods a few times in the last few months and have discovered their 'Calia' line, which I think has some surprisingly cute stuff, including some leggings with pockets. The line was launched by Carrie Underwood, but is now Dick's owned.
I think most bottoms you wear can be dressed up depending on the kind of top you wear (maybe except for certain joggers).