You should be out of Patong before the real madness starts. After Patong just one real village, so you should be ok. Normally it takes max 1 hour, I would schedule it with a bit more margin though.