I just replaced the bushing in mine using an old tool that slips down the tailshaft and locks onto the bushing, then you draw it out like a damper puller. The tool was sold by Snap-On, I'll try to post a picture later, It's at the shop 20 miles away and it is Sun. 
No, You don't have to remove the tailshaft housing.