This. Milo might be fringe. Charles Murray is not (and can people please stop citing the SPLC as an authority on anything?), he has written a great many books about a huge number of causes of poverty in the modern world (his newest book discusses problems in the poor, white, communities).
Moreover, ideological diversity is needed to challenge bad ideas. You see this at small companies all the time where everyone believes the same thing and thus they are too blind to see the cliff coming. Every place needs “negative nancies” and at most tech companies/universities, that means they need people like Peter Theil and Randy Barnett.