This is exactly what Apple, Facebook, and Google all did. None of these companies targeted mainstream markets in their early days — and neither should you until the time is right.
6 Costly Mistakes to Avoid as a First-Time Entrepreneur
Josiah Humphrey

Do provide your citations to give support to your conclusions here. I think what you are trying to say is that startups should be prepared to be able to manage the mainstream market even if that is their target.