This drives another observation about human behavior and genetics. Some species drive genetic improvement by having short gestation lengths and time to fertility. It matters less if you have genetic variability in females as any one female line can rapidly reproduce.
Others species have very large numbers of young with high genetic variability between them. Here too it is beneficial to have genetic variability in both females and males because that doubles population subject to beneficial changes and any loss of females due to adverse mutations is made up for by the high fecundity among good females. This is helped by the fact that fertility is one of the first things to decline with poor genetics.
Many species take advantage of both of these.
Humans on the other hand have long gestation lengths and very slow development periods. So they can't afford to have high genetic variability among females. So instead we have variability among males; who are then culled down via various factors (war, mutations, and female selection). But this only works if women are encoded to chase only the best men (which they are), and polygamy enables the best men to sire children with multiple women (which in most human societies it does).
This also tells you the problem with monogamy: it will lead to genetic stagnation and an accumulation of genetic mutations in the population. I've never heard this worried about by geneticists, though I've not looked, but I have seen some commentators worry about accumulation of genetic mutations due to the recent advances in childhood medicine.
However there is a problem with pure polygamy: with it will lead to a narrowing of the genetic pool, a loss of beneficial genetics, and eventually inbreeding, declining fertility and fitness. Hence it is genetically beneficial to either have low grade polygamy (10-20%) or to cycle between monogamy and polygamy (hello civilization cycle) where in early genetic polygamous gains are normalized though the population via monogamy, also breeding genetic distance, before switching back to polygamy again.