I land in my backyard regularly. It used to be that we could land on town roads years ago, but the laws changed. Without a ground crew it wasn't really safe.
There are three farms within a mile of me who have 2000+ foot grass strips, and they get regular visitors. My yard isn't groomed as much so thankfully few people drop in.
Some municipalities have created local ordinances against landing on site not approved by the town. The legality of those ordinances is not clear.
My homeowner's insurance does not care, as I do not advertise and encourage the public. My aircraft insurance does not have a restriction about uncharted or sod/dirt strips.
If you are new at the game, I suggest that you walk the field before hand, and already have experience landing on rougher grass or dirt.
The FAA is aware of my landing area, but I chose to not have it charted. Just adds to map clutter, and anyone in the area with an emergency has a ton of alternatives, most of which are better.