I don't think it makes that much difference. Django Reinhardt did pretty well with only two fingers.
it's nature and nurture.
i believe genes play apart, but what a person does in his life also helps contribute to the size of the hand.
piano and guitar players who play the instruments since young tend to have bigger hand than those who start later on.