This question is prolly getting closed as opinion based, but meanwhile I will try to give you a somewhat-of-an-answer (an opinion, if you will):
If you are asking about becoming a pilot, having a prior education will not harm you. The selection processes involved in pilot career path are, however, very complex, and involve many considerations that might not be obvious at first glance.
While successfully performing the duties of a pilot in command of a modern aircraft does require above average intellect (yes, I dare say so), there is such a thing as being too smart for the job (yep, I dare say this too). The skill set of a professional pilot is a mix of high and steady cognitive performance across a very wide range of circumstances, ability to easily adopt new information, to resolve problems under extreme mental load, good motor skills integrating well with preferably above average sensory capabilities.
Your education and career as a physicist (?) does portray you as a person with the ability to absorb and process difficult concepts, but there is so much more that your employer is looking for, so it hardly is a deal breaker, one way or another. I know pilots with former or parallel careers as engineers, doctors, CEOs, architects and so forth. You name it, they got it. As long as you are not the garden variety Einstein, it's unlikely your intellect will be seen as a problem.
Other aviation careers do not differ much in general sense, unless of course the career you are thinking of specifically can make use of your special skills and knowledge.
P.S. I just noticed John K had already posted an excellent answer, pretty similar to this one, but I'm not gonna let my typing go to waste :)