
Companies like Facebook and Twitter rely on an army of workers employed to soak up the worst of humanity in order to protect the rest of us. And there are legions of them -- a vast, invisible pool of human labor. Hemanshu Nigam, the former chief security officer of MySpace who now runs online safety consultancy SSP Blue, estimates that the number of content moderators scrubbing the world's social media sites, mobile apps, and cloud storage services runs to "well over 100,000" -- that is, about twice the total head count of Google and nearly 14 times that of Facebook.
This work is increasingly done in the Philippines. A former US colony, the Philippines has maintained close cultural ties to the United States, which content moderation companies say helps Filipinos determine what Americans find offensive. And moderators in the Philippines can be hired for a fraction of American wages. Ryan Cardeno, a former contractor for Microsoft in the Philippines, told me that he made $500 per month by the end of his three-and-a-half-year tenure with outsourcing firm Sykes. Last year, Cardeno was offered $312 per month by another firm to moderate content for Facebook, paltry even by industry standards. [...]
Eight years after the fact, Jake Swearingen can still recall the video that made him quit. [...] Three days in, a video of an apparent beheading came across his queue. "Oh fuck! I've got a beheading!" he blurted out. A slightly older colleague in a black hoodie casually turned around in his chair. "Oh," he said, "which one?" At that moment Swearingen decided he did not want to become a connoisseur of beheading videos. [...]
"Everybody hits the wall, generally between three and five months," says a former YouTube content moderator I'll call Rob. "You just think, 'Holy shit, what am I spending my day doing? This is awful.'" [...] "If someone was uploading animal abuse, a lot of the time it was the person who did it. He was proud of that," Rob says. "And seeing it from the eyes of someone who was proud to do the fucked-up thing, rather than news reporting on the fucked-up thing -- it just hurts you so much harder, for some reason. It just gives you a much darker view of humanity." [...]
"I get really affected by bestiality with children," she says. "I have to stop. I have to stop for a moment and loosen up, maybe go to Starbucks and have a coffee." She laughs at the absurd juxtaposition of a horrific sex crime and an overpriced latte.
Constant exposure to videos like this has turned some of Maria's coworkers intensely paranoid. Every day they see proof of the infinite variety of human depravity. They begin to suspect the worst of people they meet in real life, wondering what secrets their hard drives might hold. Two of Maria's female coworkers have become so suspicious that they no longer leave their children with babysitters. They sometimes miss work because they can't find someone they trust to take care of their kids.
Kind of amazing that on top of everything else we've figured out how to dump our emotional pollution in developing countries too.
Honestly, I have no idea what JWZ might think, but the number of "OMFG NAZI CENSORSHIP" comments on the original story make me not want to live on this planet anymore. I guess I missed the part where child abuse and rape were inalienable rights endowed on us by The Creator (or bestiality + kids, I can't say I've even read about that one being prosecuted!). We're doomed, not only because there are sick fucking assholes out there but also because lots of people think it's a-ok. No means yes and yes means anal, anyone?
Even if they were censoring something that a sane person would consider censorship, it's Facebook's website, they can block whatever they want.
The real question is, what kind of person reads a story about how much having to look at this kind of shit screws with your mental health, and thinks the solution is "don't block it, let everyone look!"?
At Keek we had our QA team do the filtering. You'd be surprised at how much human filth you can fit in a 36s video.
You could see their souls dying bit by bit every day as they came in to go over all the flagged content. Eventually just getting dicks all day was considered an amazing blessing.