This is the fallacy that keeps cropping up. By definition, diversity means people of different backgrounds. That encompasses more than gender, race, sexuality, neurology, etc. Diversity includes people coming from different socioeconomic, educational, and even career backgrounds.
If someone never goes outside their comfort zone and never hires from a diversity mindset, how could they possibly know whether the people they rejected would have failed? They can’t, therefore that’s a bias.
In many hiring contexts, managers complain that recruiters only match skills and can’t assess the quality of candidates. That’s because people are more than their acquired skills, bringing different experiences and points of views to bear on problem solving. That’s why historically investment banks and hedge funds hire associates from all sorts of fields (albeit mostly from Ivy leagues), including dance. So it seems strange to run the counter argument to explain the lack of diversity.