If it feels good now you certainly don't want to be moving to a size larger. Mine still feels the same after almost 3,000 miles (albeit that's only a few riding days for me).
Other thoughts:
It's much noisier with the additional chin/neck piece removed.
The Pinlock visor is awesome, mine has...