IMHO, nothing beats clean machine marks, but since you aren't milling...
Sandpaper works just fine. What grit to start with depends on how rough your cut is. Somewhere between 80 and 180 should work. Go up to about 600 for a brushed metal look, or you could keep sanding to 2000, and then use...