The answer to this issue is right in the name of the institution. It’s the Hall of Fame, not the Hall of Great Stats. Players need to have achieved some level of notoriety to get in.
If I have to sit and watch great Jags players of the past like Jimmy Smith and Fred Taylor get screwed by their small market, then it damn well better hold for Matt Stafford. Statistically impressive players who didn’t manage to make an impact on the larger NFL will not make it into the Hall, same as now.