So apparently Medium has a fake account problem. Today they announced a mass-removal of all the spam/fake followers.
If you see a big cut in your followers, although it’s a hit to the ego, at least you’ll know the followers you do have are more-likely to be actual humans.