from the picture 1/4" looks like about half of what was originally there.
Could you have used a buttonhead hex bolt in place of the stock one that you had to grind around? You may have gained a few millimeters of clearance.
(nothing like 20:20 hindsight, right?)