In addition to all of the great suggestions you have received, I recommend wearing a back support brace, the type that you wear when you're doing heavy lifting, when on the bike.
In addition to providing extra support to your core muscles, it basically forces you to ride in the correct posture...