Hi Jimbo
My feelings have always been that if I have to go to a certain place in order to catch transport that i may as well take a bit of time there and look around.
There is certainly a lot to see and do in Phuket culture/scenic /fun.
Shouldn't break your budget either as there are places to stay to suit every pocket.
Have a great time.
Cheers laurs