Dont let them scare you off Cameron, Phuket is a great place to take the family. If you want to get away from the "scene" as described in the previous posts, stay in Kata beach. Still plenty to do and see but the seedier side is diluted to the point of being almost non-exsistant unless you go looking for it. Even in Patong, it is limited to a few areas.
I still find Kata to be my favorite part of Phuket for quality of beach and the locals seem a lot more relaxed and friendly . You can access all the "delights" of Patong if you want by a short Taxi ride, but you certainly dont have to go there.

__________________
I love Thailand this much