Either way you look at it the column is going to have to be pulled to fix it. Nothing you can do to fix it with the column in. They are really pretty simple to fix just take some pictures so you can reassemble correctly.
Trent I found that little nut and bolt on the top side as well. What a difference that made in taking out the L-R free play in the wheel.