I've owned / own pretty modest boats compared to my overall financial picture. I don't want to have to worry about the financial end of boating or have to sell (probably at a loss) if a problem comes my way.
I am a family man myself. My kids have been on the boat since 6 mos old. The last few years I have boated less manily because the kids are involved in sports, music, etc. and that takes away from boating time. Just the way it is.