Big Tech’s Accountability Problem

Twitter is well aware of the manipulation that takes place across their platform, yet continually refuses to address it

May 29 · 8 min read
Credit my wife, Dollee Bhatia, with data wrangling

Welcome To The Circus (We’ve Got Bots & Sockpuppets!)

Yoel Roth is Twitter’s Head of Site Integrity. I can objectively say that he is failing. Miserably, in fact.

As a direct result of Yoel’s inability to effectively do his job, I have received numerous death threats, I have been doxed, and my Twitter account is currently restricted (such that I can only use Twitter to DM with accounts which follow mine):

Twitter has put me on a 7 day timeout.. for doing the work which they refuse to tackle

The reason my account is restricted is because I was mass reported by inauthentic Iranian-focused accounts:

If you believe that @persianhuman is an authentic account.. then I have a bridge to sell you!

Since I initially posted data highlighting their coordinated inauthentic behavior more than 4 months ago, this group has harassed my wife, swarmed, threatened, and even doxed me:

5.5K reflects tweets being counted just once (i.e. retweets of same tweet are excluded from the count). Including retweets the dataset is comprised of ~85K tweets. Be sure to check out the full thread where I link to hundreds of examples of accounts which violate Twitter Rules

Threats, unfortunately, are a regular occurrence given the nature of my work. I have opted to spend the past 1.5 years researching social media manipulation — developing techniques and tools to identify information operations.

In the beginning I would report some of the threats to Twitter; I gave up on that, however, after they dismissed a death threat I received from the XRP Army as not being in “violation of the Twitter Rules against abusive behavior:”

Being Silenced (The First Time)

While my account is in this “temporarily limited” state, Twitter has essentially stripped me of having a (public) voice on their platform.

I was similarly silenced by Twitter back in April 2017, when I was no-platformed by Twitter-owned Periscope (yes, I was no-platformed before no-platforming became en vogue).

Twitter didn’t like that I blew the whistle on pedophile networks which are rampant across their live video ecosystem — so they opted to remove me, rather than devoting proper resources to content moderation:

BBC covered this twice (here and here); it was also covered by Slate

#NIACLobbies4Mullahs

Last Saturday (May 25th) the same group of Iranian-focused accounts, which, for years, have engaged in coordinated inauthentic behavior, launched a propaganda attack targeting the National Iranian American Council (NIAC):

Source tweet (from NIAC President, Jamal Abdi)

Below is a network graph representation of 6,638 Twitter accounts that tweeted, retweeted, or were mentioned in tweets which include #NIACLobbies4Mullahs (source data: 95,108 tweets between May 25th, 2019 and May 26th, 2019):

Each dot (node) represents a Twitter account. Lines connecting accounts (edges) represent relationships between accounts (for example, if account A adds account B to a tweet where Account A has also added #NIACLobbies4Mullahs, then Account A and Account B will appear connected via an edge in the graph)

NOTE: I am not asserting that every account in the graph is inauthentic (please spare me the “your methodology is wrong, Trump isn’t a bot!” tweets) — this simply maps the relationships between accounts in the dataset

Below are 20 accounts that each retweeted tweets which include #NIACLobbies4Mullahs hundreds of times:

Accounts include: @AzadProtest, @57Pktdw, @jumpAvocado, @Golden1282, @Amirami80593551, @Mehraeein, @Azad77919645, @parham2121, @barandazold, @Zana_Paiz, @pedare_soshia, @ShahanshahiBot, @WPpID3ESIshHHfY, @_Masloub_, @MRATHEIST98, @Originalityfake

My favorite, of course, being @jumpAvocado — which is oddly fond of Iranian musician and television host, Arash Sobhani (@Originalityfake wasn’t far behind as my second favorite!):

Arash Sobhani is featured twice in @jumpAvocado’s profile: 1) header photo, 2) pinned tweet

There was a large spike in tweet volume from @jumpAvocado on May 25th (477 tweets), when the propaganda attack targeting NIAC took place:

One of the accounts, @paiz_zana (userid: 799637272412954625), has since changed their username. Cycling through usernames is a tactic which is frequently employed by nefarious actors (this is done to make detection more difficult).

The account’s current username is @Zana_Paiz. I have never interacted with the account, yet it has preemptively blocked my account (this is quite common):

Out of “zAnA’s” most recent 598 tweets, 212 of them (35.5%) include #NIACLobbies4Mullahs.

Here’s a summary of the accounts which most actively amplified (i.e. retweeted) the #NIACLobbies4Mullahs hashtag:

Based on the most recent ~500 tweets for each account; % retweets = retweets/tweets; % hashtag = hashtag/tweets

As a result of large-scale platform manipulation, the group succeeded in getting the hashtag to trend (they regularly manipulate trending hashtags; see this thread for another example!)

Sorry, Alireza! All this shows is that the group is able to manipulate Twitter trends via automation and leveraging inauthentic accounts

Astroturfing

By gaming Twitter’s platform to make #NIACLobbies4Mullahs trend (via coordinated inauthentic behavior), the group seeks to create the illusion of a larger support base than is reality. The vast majority of engagement (retweets/likes) on the below tweets are driven by inauthentic accounts:

Source tweet
Source tweet
Source tweet

Astroturfing: the deceptive tactic of simulating grassroots support for a product, cause, etc., undertaken by people or organizations with an interest in shaping public opinion

Ultimately, this ends up getting picked up by Al Arabiya (job well done, @jumpAvocado!):

Source tweet

#NAICLobbies4Mullahs

The above hashtag is virtually the same as the one we looked into earlier — with the exception being that this one begins with NAIC (typo) rather than NIAC.

Here’s the first tweet I found using the erroneous hashtag:

All the engagement (retweets/likes) on @omidvi’s tweet is being driven by inauthentic accounts

Sometimes these trolls can be funny (they even gave me a verified badge in the below image.. which is an upgrade vs. my actual Twitter account!):

One of the earliest authentic accounts which tweeted the (typo) hashtag was Mariam Memarsadeghi:

Mariam’s Twitter username is @memarsadeghi

Scanning through the accounts which tweeted the erroneous hashtag (and those which engaged with said tweets), it’s clear the vast majority are inauthentic.

Accountability

I personally find it difficult to trust Big Tech given my experiences with Twitter, across multiple fronts. There is a large (and growing) contingency that also feels Big Tech lacks transparency, proper communication, and accountability.

Specific to the pedophile networks which are rampant across Twitter’s live video ecosystem, Twitter told BBC in July 2017 that they have “zero tolerance” for this kind of conduct:

Periscope’s comment moderation feature at that time actually facilitated sexual exploitation of children (brought to the attention of Twitter by myself and many others):

Meanwhile, Twitter was touting their “strong content moderation policy” and reporting system (the reporting system was also a joke).

Ultimately, it’s very easy for Big Tech to make statements which don’t align with their actions/reality. Moreover, Big Tech can opaquely and unaccountably remove people from their platforms, just like Twitter did to me in April 2017 (and after I had invested significant amounts of time/money to build an audience of 35K followers).

Fast forward to today, where Twitter generally ignores (blatant) platform manipulation that often involves researchers/academics spoon-feeding them data/evidence.

Twitter does engage with a select group of “Official Partners” and a handful of individuals. If you don’t fit that bill, however, and you bring substantive information to Twitter with respect to platform manipulation/influence operations, chances are you’ll be ignored.

As was the case with Twitter’s public statements re: pedophiles grooming children across their live video ecosystem, Twitter similarly opts for virtue signaling over substance, stating they “proactively identify suspicious account behaviors that indicate automated activity or violations of [their] policies..”

That’s what they say, at least:

Source tweet: (from Twitter’s Legal, Policy and Trust & Safety Lead, Vijaya Gadde)

In practice, Twitter is nothing but reactive in this regard. Moreover, they are entirely complicit and negligent.

So, How Do We Fix Things?

Given the inherent conflict of interest (properly disposing of inauthentic/inactive accounts will devastate platform metrics!), it is my position that Big Tech companies shouldn’t be allowed to self-police:

In the context of Twitter (who is more open with their API than others), it is possible to audit their work.

For example, I am certain that 90%+ of the nodes/accounts in the below graphics should be suspended for engaging in coordinated inauthentic behavior (Twitter has opted to remove some of the amplifying accounts while allowing the main benefactors of said amplification to remain active):

Graph represents interconnectedness (Following/Followers) of ~400 accounts which are part of MEK’s propaganda machine

I am being intentionally vague about these graphs as I will do a separate post which will deep-dive the accounts (most of which are connected to MEK trolls + astroturfing).

What I would like to call attention to is that the same accounts I have highlighted above (namely, @no2censorship and @peymaneh123) were identified over a year ago in a peer-reviewed academic journal:

Twitter: please start doing your job more effectively. From what I have seen, it doesn’t appear that proactively mitigating against information operations/platform manipulation is a priority


Geoff Golberg is an NYC-based researcher (and entrepreneur) who is fascinated by graph visualization/network analysis — more specifically, when applied to social networks and blockchain activity. His experience spans structured finance, ad tech, and digital marketing/customer acquisition, both at startups and public companies. Geoff spends (far too much of) his time developing techniques and building tools to identify social media manipulation (of various flavors!)

Geoff Golberg

Written by

Founder, Social Forensics | Previously: Co-Founder, Elementus | Featured in BBC, CNN, BuzzFeed, and Quartz, among others | geoffgolberg.com

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch
Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore
Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade