In some industries like book publishing the middleman is indispensable. That agent got you in the door. You became a known commodity. Only as a known commodity were you able to walk around your agent and get the deals you wanted. The fact that you don’t recognize this doesn’t say much about your character.