No tough-guy attitude here, and no, I would not take physical action. But I do throw up a stream of water with the garden-hose when I'm out washing a vehicle and some ***-hat comes haulin' *** down our street. And I'm lucky enough to have a cop living next door and I'm not above getting him a description of the vehicle so HE can go pay them a visit, since I don't think he'd appreciate having his dog, cat, or child mowed down in front of our house. And the majority of the time it's some punk kid who lives in the neighborhood so finding him is not usually a problem. And no, I don't speed through a residential area, ever. And yes, it tends to piss the folks in their cages off, as I've had them pass me on my own street.
My personal favorite place (and I'm probably not alone on this one) to "wick it up" is NV Hwy 50. Long, straight stretches, nice low vegetation so you can see the critters (although I don't worry too much about Mormon crickets), and miles of highway without any other vehicles. I don't recall ever seeing a child playing on Hwy 50, although I have seen bicyclists and gave them all the space they would like to have. In any case, the other items you mention (weather, road conditions) affect only me, not pedestrians, pets, or other vehicles. I'm sure you have your own favorite, I just hope it's not a neighborhood.