The campsite villager doesn't move in unless you ask them to. So don't worry, but LUCHA won't invade unless you give him permission.
Edit: I guess you're talking about the first camper the game throws at you? If that's the case, that camper is forced on you, which means L U C H A is inevitable.
I want to say that, assuming you have five villagers already, you're forced to have a smug villager move in from your campsite to move on with the "story". I'm personally not sure if inviting another villager would bypass this or just give you two villagers moving in.
I think that you'll just get both. I was going on mystery island tours for a while but there we no more possible villagers spawning on them. That same day I had just gotten the campsite with Curlos in it and was hoping to avoid moving him in. I kept talking to Nook and he kept asking me to check out the campsite and to work my magic.
I eventually just moved in Curlos and villagers started appearing on the mystery island tours again. I got Bianca the same day I asked Curlos. I think you have to have the first campsite villager in order to progress.
My friend had Hippeux in her campsite and just ignored him. The next day he was still at the campsite soooo...
You can avoid random move-ins through nook mile tickets or using amiibo, however the first villager that visits your campsite is a forced move-in which sucks...