Strictly gender based? How do you explain those out of the gender binary? Bisexuality? Pansexuality? Clearly it’s not as clear cut as you make it. Pedophilia is a sexual orientation based on age as well as gender.
No one is saying or debating whether it is moral or not. Just stating the reality of what it is.