I essentially did something similar when I got married. We did a destination thing in New Orleans and got down to NOLA 3 days early with friends slowly trickling in whenever. I would suggest extending the party after the wedding, if possible, though. Nothing like already being exhausted by the time your wedding day comes! Though I had so much fun with my pals and family ahead of the wedding that I would totally do it again.