I think most people assume that, given a choice, most women prefer a bigger (rather than a 'smaller') dick, hence the 'raised eyebrow' if a woman expresses a preference for smaller.
By the same token, its assumed that women are drawn to 'tall dark and handsome' men, while some clearly are drawn to short, fat balding guys, who may have other redeeming features (like a huge schlong or a Cayman Islands bank account.
)
There are women out there who are happy with small - ask my wife...