Don't take any chances. Pull the drive. It's not that big a deal. Do it on your terms not the boats terms. Better to be safe now than to be sorry later.

Pic below -- look dead in the middle of anti siphon valve - it was taken out and the ball dead middle was punched out or fell out upon removal - I see it all the time.

The ball bearings in a broken gimbel bearing and traveling forward is very slim as the U joint shaft is going thru the grease seal and has no opening for anything to pass thru,https://cimg1.ibsrv.net/gimg/www.off...e2247ea3d5.jpg
think about it. .

WHOOPS THERE IT IS.......... https://cimg7.ibsrv.net/gimg/www.off...0f2f1719a7.jpg