Hi! I did some research into the terms and in short, I think you're fine. While it seems like uranic is more often used by nonbinary people, it wasn't meant to be an exclusive term and anyone can use it. I definitely understand about not wanting to use terms that would hurt anybody, as I've had similar concerns in the past myself, but I wouldn't worry about it with these. I'm nonbinary and I don't see anything wrong with uranic/nofem, and the complaints I did see about them seemed to be based on a misunderstanding of their definition. I'm not sure if this was the same thing you saw, but I saw something that seemed to assume the terms were based on assigned gender at birth rather than gender identity, which doesn't seem the case to me at all. In any case, there doesn't seem to be any widespread controversy over them, and we can't control the genders we're attracted to, or aren't. I'd say if it works for you and either term makes you happy, go ahead and use it.
With that said, since you also said you hated labels, don't feel like you have to use either term just because they're a technical fit. You can use broader umbrella terms if you feel like, or choose not to label yourself at all. There's also a lot of people who consider themselves mostly straight and are happy just going with that, but don't hold yourself back if other identities/not labelling yourself at all speaks to you more. I called myself straight and cisgender for a good while because I was afraid of "overstepping", and uh... that wound up being incorrect in just about every way possible, ahaha.