The Axes of American Politics
Yonatan Zunger

Your reasoning as to why we have a two party system is spot on. Welcome to the mushy middle. On the other hand a three party or multi-party system means a small minority party can function as a spoiler and wield outsized influence and yank things too far to the fringe, as the not quite majority party caves into a potentially radical special interest party in order to form a government.