I always thought driving gloves, when paired with an appropriate vehicle, oozed cool. I mean look at Ryan Gosling character from Drive. Sure the guy has...
I don't think grip is a serious concern in modern cars where you can dial in the climate controls to perfect comfort quickly and easily so your hands aren't sweating. Driving with cold hands on a cold steering wheel also sucks, but the above is true for heating as well. I assume that's part of why they've fallen out of usefulness.
Also, if you don't look cool behind the wheel without driving gloves they aren't going to fix that.
But everyone's situation is different with comfort and what they're driving so do whatever you want. If some tollbooth worker laughs at you then who cares? You're out having a nice drive and that guy's stuck in a tollbooth.