I'm looking at a 2006 23 outlaw with 496 mag. Are these good boats. Or should I stay away

"good" is relative. Always get a survey, and try to get the history on the boat. True hours, boating environment, you can tell alot just by it's physical appearance. Yes the 23 Outlaw is good and Yes the 496MAG is a good motor. How far away from "good" an owner has taken the boat is another question (to be answered via your diligence with the boat"......

Yeah I was just curious to how they handle and build quality. I've driven a 25 outlaw a few times but I've never seen a 23 in person.

There are some 26 Outlaws out there, you might want to consider a tad bigger than what you have your sites on. That way, you have something to grow into vs. growing out of.....

Yeah I decided to pass on it. Guy selling one locally for cheap. 20k but I think I'd be unhappy with it and end up selling it.