I feel like everyone is forgetting the worst aspect--- every time you enter a building/store, the owner will trail right behind you and question all of your purchases as soon as you look at something ! That would be insufferable...
Plus, if you wanna walk down an aisle, you'll have to weirdly walk into them over and over as they slowly walk backwards until you free yourself to run around again.
Other than that, yeah, I imagine fishing/catching bugs all day and collecting furniture from the trees and sky would be pretty cool. Until it's a table or an iron frame.