If you had a villager move out that didn’t go to someone specific, they end up in your “void”. When you travel to a town with less than 10 villagers, a villager in your void will move into then town you travel to. To clear it, you can visit a town that has all 10 villagers in it