I leave 'em on. I don't see a downside, and I can always stop for some BBQ takeout or some bagels to bring home if I see a good place.
As for the trunks, they look practical, but fugly, IMHO. My son says that any bike that has one is a "geezercycle". I'll probably get one, but I need to...