That's too much, the thing is with mine, the vibration also wore out the thrush washers and broke the front sprocket and woodruff key.
This on a 20K engine. Although I did drive it hundreds of miles after I noticed the noise.
It would be easy to remove starter motor and see if the flywheel is loose but I think you will have to take the sump off to replace thrust washers.
Danny