Oh, it's no problem! Just remember to clear your void, it may cause a few problems for the person who may pick them up and wake up the next day to find an unwanted villager in their town. lol.
It's sorted out now, I had to move out Annalise which took 2 hours and then I got Molly. It took another 2 hours to get Wolfgang out and now I'm waiting to get Tipper.
I'm sorry if my post seemed a little angry or something, I just woke up like 10 mins before that. haha