Spending years being ferried off and on shore by helicopters, I'd say the biggest problem is noise. Even with a pair of decent ear defenders on it's not exactly quiet.
OK, so a commercial 'air bus' is never going to match a Mercedes or even a plush executive helicopter for levels of NVH, but there's nothing particularly attractive about the experience other than getting somewhere much quicker than you might otherwise.
The noise also means the 'go anywhere' ability of helicopters is severely curtailed if noise means they can't actually go many places.
Add to that the high cost and it's pretty much a non-starter except for edge cases as in SentryRaven's answer where an increase of speed of an order of magnitude or more, or the circumvention of otherwise impossible access outweigh these concerns.