Oh dear, no!
Many many "manly" (brave, outgoing, flirty, etc.etc guys) have a manly personality to.... hide something. You know what I mean.
Nonetheless, penis size matters, but what matters the most is what you do with what you have. You might be a lucky girl and hit a 10" but if he is a total sex ignorant, you will hate having sex with him. But you might find a loving, caring, aware of this 4" sword and get you to heaven and above.
I won't advice you to, but "shop around" :P
There are many sizes in the market. And not just because the box is pretty, brave and smart doesnt mean that what is inside it is big, brave and long-lasting :P
-Jean
(I should really go to sleep o_o)