I doubt riding off pavement now and then has much to do with the requirement to rebuild your forks. Nobody is saying you can ride fast, like on a dirt bike fast, on dirt roads. But moving the forks up and down a bit doesn't cause them to fail as long as you are not maxing them out constantly.
Afterall, that is what they are designed to do.
Afterall, that is what they are designed to do.