By accepting the $50 million contract he was basically giving up editorial control over the content of his show. In other words, Comedy Central and Hollywood were going to dictate what he could and could not make jokes about.
Meanwhile, he would be beholden to Viacom and their affiliates. Forced to attend events, and participate in things he didn’t necessarily want any part of. He was potentially giving up his freedom to sign that contract.