How about liquid democracy? For me it solves the problem, except in the extreme case where everyone delegates to the same few people and never change their delegation.