i'm gonna say 'yes' because there really is no point in playing a game you can't enjoy. so if you feel that your 'ugly' town is hindering you from having fun, then by all means restart until you find a perfect town that suites you. that's what i did when i first got the game.
I said yes. You probably will have fun, but when I deleted my first AC town I figured it was the worst mistake, I started to miss it and want it back, ='[
Well, you did take money and items from hackers, that definately does ruin it. If you restart, dont do that or TT, and you will have much more fun playing fair.