Is the 32b a noticeably smaller boat? Or would it ride similar? I'm only familiar with the Spectre I had.

It is not a smaller boat. It has a bigger freeboard and more "tucked in feel" in the cockpit. The cockpit is smaller than a 36 Spectre but the Skater has a longer bow than any Spectre. It's also wider (I think)as it is 9ft 2 of beam. We have a 32B and it's a much bigger boat than what it is.

I have considerable time in both, the Skater doesn't really feel smaller...although the Spectre does have more bow out in front of you. The Skater runs like a much bigger boat. If its too rough for the Skater, its too rough for the Spectre.

I went from a 30 Spectre to a 32 Skater B

I think it depends on the drives. A 6 boat is different than a Bravo

My boat was a bravo boat. 36' Spectre 10'4" wide
I know the 36 skater is a bigger boat, tunnel depth width etc, but was t sure about the 32b. I'd want a #6 boat.

A 32B will not disappoint