I had an 07, LOVED It...bought it new (leftover) $4653 out the door.. tax, tags, all in... 6 years, 10000 miles later traded it in on the FJR (got $2500)
I did fine off road trailing with it(a lot), .. it will do all but jumping reasonably well... ruts and roots were handled well, and traction was great...and I wheelied every time i left my driveway (I miss that the most...)
For me, it was comfortable for 3-4 hour rides, but between some nerve issues I have and the wind buffeting, longer rides weren't as enjoyable(for me)
2 of my riding freinds also had KLRs, one 09 and one 11 ... mine felt more "dirt bikey" to ride.. thiers were smoother, quieter, and seemed to have better suspension on the highway...huge difference. Also have a freind with a klx250.. as long as your dual purpose spot isnt too far away, that bike is a BLAST to ride.
For what you describe as your desired role.. the KLR will fit the bill well... you should be able to find a new leftover for $4000 all day...or a well kept used one for $2000
Tires, chain maintenance and oil changes are about all you really need to do with this thing.. it will run forever and never let you down.
If you do want to get rough with it... as Shane mentioned above..there are known failure points, well documented, with kits available for all of them...but you wont need that stuff if you are just going to ride as you described. I never broke anything out of the ordinary, and i was not "gentle" with it.
I did the doohickey on mine...but its not needed on newer models, (i think 09 and up) they improved it.
oh.. and if you plan on wet feet... changing the footpegs out should be your first farkle... the rubber ones are not good at all.
if you get an 07 or older, look at this post:
https://www.advrider.com/forums/showthread.php?t=260383
all the part numbers to do footpegs on the cheap are there... they worked awesome.