Speaking just for myself, I have nearly a 7" wrist and wear my midsize 36 mm Seamaster as my everyday watch. I can wear it in casual and formal occasions. Hell, I didn't even know it was the Goldeneye watch until a couple years ago. And contrary to popular belief, a bigger watch is not a "better" watch.
No matter what size your wrist is, it all comes down to your personal preference. For me, I have skinny arms and don't like feeling like I have a hockey puck strapped to my wrist. Back in the day, I had a 46mm Citizen Skyhawk as my everyday watch and felt utterly ridiculous wearing it.
If possible, try both and see what is most comfortable and what feels "right" for you. It's all subjective. And the only "right" answer is your own.