I'm not completely sure how the whole trading villagers works, if I am wrong then please tell me. Is it possible for someone to pick up a villager who is camping in someone's town? If the answer is yes, then anyone is free to come pick up Moe.
No, you cannot pick up someone from a camp.
The best bet you could do is tell him to move in, and them give him away.
Otherwise, he will not go anywhere.
