There is flight club at our field and this discussion came up. A regulation cited would settle the matter.
It appears that the answer is "there is no such regulation". For example, from AOPA's Flying with Family:
Airlines require that any animal on board be confined to an animal carrier at all times. Although there are no such requirements for general aviation aircraft, it is always better to err on the side of safety and keep them in a carrier.