Carl, maybe just try tapping that part of the bushing exposed on the right side (the 4mm you refer to) and apply some penetrating oil. It only has to move a tiny bit to free up the relay arm sleeve which is restrained by the left side of the bushing and the right side of the left frame tang. Be gentle with the tapping, use a soft face hammer. The bushing has a very close fit with the frame tang as is needs to slide axially and have very little side clearance. (excellent write -up above by Fred our in-house techno poet Laureate, by the way).
Where you indicate it is 'frozen flush' with the left side of the right tang is where it is in contact with the relay arm sleeve. if you can move the bushing even a couple thousands of an inch (to the right, of course) you should be able to wriggle free the relay arm giving you more room to get the bushing totally out and clean it up for reassembly.