Google and YouTube moderators speak out

Google is known for being one of the best places to work. But for the many content moderators working for Google and MNgos, the job is traumatic. And even the best workplace conditions don’t make up for the fact that many moderators suffer long term psychological consequences of doing this job. The Verge traveled to Washington, DC and Austin, TX to speak to a former full time google moderator and to current MNgos contract moderators to see how their experiences compare.
Following his investigations on Facebook, The Verge’s Casey Newton reports on the working conditions and side effects of scrubbing the internet of “violent extremism” content at Google and MNgos. You can read the full exclusive here: bit.ly/2PqraAV
You can find Casey's story about the working conditions of Facebook moderators in Phoenix, AZ here: bit.ly/2IqQHqb
Subscribe: goo.gl/G5RXGs
Like The Verge on Facebook: goo.gl/2P1aGc
Follow on Twitter: goo.gl/XTWX61
Follow on Instagram: goo.gl/7ZeLvX
Why'd You Push That Button Podcast: pod.link/1295289748
The Vergecast Podcast: pod.link/430333725
More about our podcasts: www.theverge.com/podcasts
Read More: www.theverge.com
Community guidelines: bit.ly/2D0hlAv
Wallpapers from The Verge: bit.ly/2xQXYJr
Subscribe to Verge Science on MNgos, a new home base for our explorations into the future of science: bit.ly/2FqJZMl

Сэтгэгдлүүд

  1. The Verge

    The Verge3 сарын өмнө

    Have you worked as a content moderator? Would you be willing to go on the record? We'd like to hear your experiences. Email Casey Newton at casey@theverge.com, or message him on Twitter @caseynewton.

  2. Moist Squid

    Moist Squid3 сарын өмнө

    It honestly cant be as bad as the terrorism posts we make over on 4chan

  3. Hannah Farrel

    Hannah Farrel3 сарын өмнө

    @M K I'd love to see you work the job I did, then say this.

  4. Hannah Farrel

    Hannah Farrel3 сарын өмнө

    @Ror R yep I worked for them for MNgos

  5. Hannah Farrel

    Hannah Farrel3 сарын өмнө

    I was a content moderator for MNgos for over a year.

  6. M K

    M K3 сарын өмнө

    Snowflakes shouldn't be hired.. Evil exists.. Grow up!!!

  7. Expert Olive

    Expert Olive11 цагийн өмнө

    You will never truly understand what they go through.. but there’s a certain website (witch is completely legal and allowed by google) where u can see this horrid stuff happening. NO I’m not giving out the sights name. No one should suffer the way me and the moderators have

  8. ashwater skydust

    ashwater skydust5 өдрийн өмнө

    So I consistently have youtube serving me up inappropriate images and concepts it knows will have a negative reaction to and subsequent to having those reactions or calling it out, it will show you other things by degrees of separation. It tries to define a boundary with benchmarks of common association to either validate or invalidate the user behavior. So it will show you things that are increasingly both similar and dissimilar at once. Yet the very fact it does that is a problem. MNgos's issue is that it cannot automate behavior to stop these attacks nor reasonably expect a human to respond to it based on how heavily attacked it has already been automated to be attacked. As a user that experiences this, I constitute it's consistency as mental harm. I can only imagine what human moderators go through who sign up for it. What a human would realize and a machine wouldn't is that these boundaries have a bubble around them. In my interactions it does not have a sense of complexity in boundary definition or if it does, it's always seeking to prove or disprove user error when human moderation is not psychologically or logistically possible. Boundaries involve complex rules. Mine personally is to not be tested on associations after you say your boundary has been violated, but that's me. While possible to define a boundary by pushing and while possible for there to be plausible deniability in it's data, the boundaries will be repeatedly broken even after the offending behavior is defined and no matter how distinctively it's defined nor how frequently. This would be reasonable to dispute if it whatever offensive content wasn't quite so heinous and sick. It would be reasonable to say the algorithm didn't understand if it didn't have a load of preloaded list of associated content to test it's definitions on. Having the ability to make those associations only shows that they are there. MNgos will try to act as if it has some reason for behaving the way it does or that you gave it the input and it doesn't understand, but this boundary is pushed constantly. Make note of the things that push your boundaries if you can and call them out when and where you see them. Unfortunately, with youtube it flies under the radar (supposedly) when things move too fast. For instance a users feed might move so fast and their inputs be so minute that offending material isn't registered (supposedly) but this is contrary to the fact that offensive content will show with associations to acceptable content. So the negative thing gets in by way of the positive thing. This is computer error. At best. Realistically we should know what is humane or okay and what isn't and none of this should be flying under the radar by degrees of association. That should not be possible. By the same token you have content with no negative being marked as such by the same paradigms that push the negatives through the positive. The positive should not have a negative reaction and the negative should not be associated with a positive one. Not acceptable. This is why big tech people always talk about "boundaries". They need those boundaries to, because we're all being attacked. This is why applying quantum computers and spying into social mechanics doesn't work. Unfortunately we wont know we're making the wrong choice for our well being or be allowed until after we're effected. I'm personally effected by this even if it's not quite to the degree these people have been. Make no mistake that the ways people will do harm can be insidious.

  9. Anant Abhyankar

    Anant Abhyankar22 өдрийн өмнө

    Didn't she sign up for this smh

  10. mike Hughes MOD #2

    mike Hughes MOD #228 өдрийн өмнө

    Your on a live streem blocking ppl for saying hello fix this problem please it's murals hunted Adventures look up the moderation team is there blocking everybody

  11. mike Hughes MOD #2

    mike Hughes MOD #228 өдрийн өмнө

    So just found out someone was. Impersonating your Google team moderators he was going bye zargo

  12. SnOwOkie

    SnOwOkieСарын өмнө

    im desensitised to gore content and so are alot of people who use discord/facebook its really not that bad to watch tbh and i wouldnt consider this a "traumatic job"

  13. RipDove Studio

    RipDove StudioСарын өмнө

    Why do you have A Clockwork Orange as your thumbnail? You know the implications of it, is that you're re-programming mods *not* to speak out. Jesus, you understand literature as much as you understand building computers.

  14. Romeo Timeex S Bat og Jr II

    Romeo Timeex S Bat og Jr IIСарын өмнө

    If we don't do it who will do it. No A.I and algorithms accurate enough to remove these videos or content online. Might be a dead end job but imagine kids seeing those videos online.

  15. jihoon's guitar

    jihoon's guitar2 сарын өмнө

    It honestly not as dramatic as this.

  16. Michael Ritchey

    Michael Ritchey2 сарын өмнө

    Content moderators will continue to work under these conditions as long as 1) Google and MNgos can get people to apply for the jobs at their current rate of pay and 2) they can retain said employees long enough that the churn balances the pay and benefits they offer. All sad but there's no real solution.

  17. Ding Dong

    Ding Dong2 сарын өмнө

    You mean "paid Democrat shills working for the world's largest tech corporations defend their policies of institutional discrimination?"

  18. Cobb

    Cobb2 сарын өмнө

    Why doesn't google use machine learning to outsource this yet? I certainly hope they are working towards that.

  19. Tony Rod

    Tony Rod2 сарын өмнө

    This is a great example of how people sell the best they have, for practically nothing. No salary that you can get is enough to compensate you for driving you to insanity. Caucasian are very prone to mental disorders. I think briefing them and exaggerating the things that they would be exposed to will help then to prepare for the things they will be seeing, but that must be managed correctly in order to work, and debriefing provided the end of the shift, tp instill in them a sense self-worth rooted in how well and effectively they perform on their jobs.

  20. Darcy Dilbart

    Darcy Dilbart2 сарын өмнө

    If this is an issue of importance to you - PLEASE watch the documentary "The Cleaners" from Independent Lens in November 2018. By and far the majority of this 'content monitoring' is done offshore by 3rd party contractors. This Verge report is only the tip of an iceberg of far larger size.

  21. MylesTube 5

    MylesTube 52 сарын өмнө

    I think you should offer Daisy a job working at the Verge!!! 😊😊😊

  22. bournvita

    bournvita2 сарын өмнө

    Dark side of internet

  23. Rodolfo Rubens

    Rodolfo Rubens2 сарын өмнө

    I think everything should be curated... This is too sad...

  24. Kilgorio

    Kilgorio2 сарын өмнө

    MNgos is weird

  25. Lx Zander

    Lx Zander2 сарын өмнө

    her: describes what she saw him: <a href="#" class="seekto" data-time="277">4:37</a> ( ( visible discomfort ) )

  26. Jay Leones Escototo

    Jay Leones Escototo2 сарын өмнө

    The applicant should be oriented specifically with what they are dealing with. Qualified applicants should be courageous and have full control of their feelings and have a strong heart. There are people out there has already immune to see these violent and graphic things most specially who work as a government officials. Google should be more careful in hiring an applicant for this position.

  27. SugarDaddy1963

    SugarDaddy19633 сарын өмнө

    nothing new its like god damned common knowledge ...everyone knows big corporations abuse and threaten their employees / contractors

  28. Romeo Timeex S Bat og Jr II

    Romeo Timeex S Bat og Jr IIСарын өмнө

    If you don't meet their demand they can just replace you. Simple hahahaha why would care about our health.

  29. DISGUYROX

    DISGUYROX3 сарын өмнө

    Mr self important interviewer is all about himself, isn't he?

  30. Shaun Collins

    Shaun Collins3 сарын өмнө

    This will add more fuel to AI though I feel for her deeply. But it will add to the AI replacing moderators. Just a thought.

  31. Romeo Timeex S Bat og Jr II

    Romeo Timeex S Bat og Jr IIСарын өмнө

    A.I can never replace human moderators.

  32. K T

    K T3 сарын өмнө

    Why can't ai do this, its damaging work for humans.

  33. Jakob Mazur

    Jakob Mazur3 сарын өмнө

    I just declined an offer for this position at Google two weeks ago. Now watching this make me happy I took that decision.

  34. Mike Porter

    Mike Porter3 сарын өмнө

    Unpopular opinion: a company isn't your parent and doesn't owe you money or work. If you want, you work for them, if you don't, you don't. If like circumstances or choices make you feel like you are stuck with your current job, that's either on you or your luck, not the company.

  35. Lone Note

    Lone Note3 сарын өмнө

    He looks WAY too comfortable in this video it isn't right especially because of the ceverity of the topic being discussed

  36. S. E. C-R

    S. E. C-R3 сарын өмнө

    This would be a hard job to do, I couldn’t do it.

  37. Wüstenfuchs

    Wüstenfuchs3 сарын өмнө

    never bothered me

  38. Arabic Courses

    Arabic Courses3 сарын өмнө

    Really sorry and sad to hear what I heard above, but in reality, and it is a sad reality, is that it is not something that anyone can’t do. Anyone can do it. And therefore there is high supply. With high supply compared to demand, you get lower pay. It’s a sad reality but that IS the reality. You can get government intervention sourcing minimum wages but that won’t do anything besides reduce the number of people employed and increase the workload on those employed.

  39. CoRSON CHEUNG

    CoRSON CHEUNG3 сарын өмнө

    other news outlets (that I've seen anyways) alter their interviewees' voices to a sorta high and... idk generally harmless one. this low alternation is pretty creepy.

  40. Mahir ぉヴェ よう ;D

    Mahir ぉヴェ よう ;D3 сарын өмнө

    I reported this.

  41. Aqually

    Aqually3 сарын өмнө

    Wow and people complain about the AI

  42. JustSome GuyWithAbeard

    JustSome GuyWithAbeard3 сарын өмнө

    Let AI do this job. It's possible isn't it.

  43. Akihito007

    Akihito0073 сарын өмнө

    How about the video of them demonitizing and deleting Conservative voices and pro-Trump videos?!?

  44. Brett Sepulveda

    Brett Sepulveda3 сарын өмнө

    I work in a completely different field and I understand what she’s talking about. Every day is a battle and I keep going because I work to live.

  45. KNOWARE

    KNOWARE3 сарын өмнө

    "Youtoooooob"

  46. Judd De Vera

    Judd De Vera3 сарын өмнө

    These 3rd party companies pays less than 30% to workers here in the Philippines I find this situation very unfair :(

  47. Judd De Vera

    Judd De Vera3 сарын өмнө

    Accenture must hear this one to increase their pay to workers -____-

  48. James Sun

    James Sun3 сарын өмнө

    Thats why AI is replacing people. Good or bad

  49. ktm640lc4BGD

    ktm640lc4BGD3 сарын өмнө

    So you made a video about hunan suffering so you can earn money on MNgos. Also, did anyone force them to do that kind of job? They just wanted easy money, watching videos and now „boo hoo...“. Just leave and get an actual job and leave this work to people who can handle it. Imagine stupid people complaining how hard it is to be a scientist. Well, maybe that is just not for you.

  50. B12 blaze it vegan

    B12 blaze it vegan3 сарын өмнө

    Did you stop supporting the violence you saw or nah

  51. 100MPH Selfies

    100MPH Selfies3 сарын өмнө

    dude looks dehydrated and hungover.

  52. YOLOItzMeee

    YOLOItzMeee3 сарын өмнө

    "Don't leave any comments," 690 comments. Great job people. XD

  53. No More BS Please

    No More BS Please3 сарын өмнө

    We can train machine learning algorithms to do it in a month. Fire them all and replace the with an automated computer system.

  54. Romeo Timeex S Bat og Jr II

    Romeo Timeex S Bat og Jr IIСарын өмнө

    Example a clip from a movie someone shoots a person. For an algorithm it will remove it automatically for being harmful. But human moderators can decide if it's a movie or not. But all this algorithms is doing a great job of filtering data and sending it to us.

  55. Romeo Timeex S Bat og Jr II

    Romeo Timeex S Bat og Jr IIСарын өмнө

    Moderators are working alongside advance algorithms but it only filters information sending it to a human moderators and leaving the decision making to us.

  56. Rohan Chaudhary

    Rohan Chaudhary3 сарын өмнө

    @<a href="#" class="seekto" data-time="703">11:43</a> and @<a href="#" class="seekto" data-time="717">11:57</a>. Lmao. I've never seen an interviewer make such faces.

  57. HARIDAS M.K.

    HARIDAS M.K.3 сарын өмнө

    Very interesting

  58. Daniel VanWaardhuizen

    Daniel VanWaardhuizen3 сарын өмнө

    Thank you for the work you do and trying to make the internet a better place for everyone.

  59. AdmiralFroggy

    AdmiralFroggy3 сарын өмнө

    Sign me up.

  60. enzmondo

    enzmondo3 сарын өмнө

    These companies are always liable for the well-being of their employees. Yet none of these companies treat the as such.

  61. zlooka al fool زينب

    zlooka al fool زينب3 сарын өмнө

    Maybe I'm the only one from Arabia ✌😁

  62. Avril Stacy

    Avril Stacy3 сарын өмнө

    I now understand why Google lost their big Gov. Contract for sexism in the workplace and harrassed and hostility toward women. I also think they pay slave wages for content. Are you paying in Rupies? Are your headquarters in a 3rd world country. Why post any valuable content on MNgos?

  63. dokha

    dokha3 сарын өмнө

    I read an article about a year ago on exactly that topic and this video did not add anything to it..

  64. BearDog

    BearDog3 сарын өмнө

    She's very eloquent

  65. Noname

    Noname3 сарын өмнө

    they protect free speech hahahahaha

  66. My Nontraditional Life

    My Nontraditional Life3 сарын өмнө

    Interesting how you said not to comment, but as long as the comment does not violate the guidelines and is done in a civil manner, commenting can be good. We need to have discussions on if content moderation is causing psychological trauma for people, but AI moderators are prone to bias and errors, how do we deal with the issue of people posting violent, harmful images online? What does it say about our society that this problem exists?

  67. Carlos Castellanos

    Carlos Castellanos3 сарын өмнө

    Good that this is being put on the table and spoken about.

  68. enduril122

    enduril1223 сарын өмнө

    Hmm, wonder if possible to use video filters that reduce the impact of gruesome images, while still allowing moderators to review and remove bad content. Black & white, vertical scan lines, anything to help these poor souls perform a badly needed service.

  69. Lennox1492

    Lennox14923 сарын өмнө

    So which dept does the political shadow banning? I thought AI did all of this?

  70. Cedric Santos

    Cedric Santos3 сарын өмнө

    When will AI start handling this job?

  71. Whole Food Plant-Based Man

    Whole Food Plant-Based Man3 сарын өмнө

    Moderator: I watch stuff, so you don’t have to. Me: Like what? Moderator: Rape, murder, shall I go on? Me: No, no you don’t.

  72. Dylan Rekal

    Dylan Rekal3 сарын өмнө

    Millennial snowflakes ❄️

  73. ابوجوري العنزي

    ابوجوري العنزي3 сарын өмнө

    ااااف يااغوغل

  74. Nigel Uno

    Nigel Uno3 сарын өмнө

    Maybe stop hiring normal people as content moderators and actual internet neckbeards.

  75. Breslin Hurley

    Breslin Hurley3 сарын өмнө

    Interesting topic. I'm surprised this video wasn't removed by Google/MNgos content moderators

  76. Javier Kujo

    Javier Kujo3 сарын өмнө

    <a href="#" class="seekto" data-time="39">0:39</a> hey, es AuronPlay! XD

  77. Yolandi Van Rensburg

    Yolandi Van Rensburg3 сарын өмнө

    I could never do this job!!!

  78. Kreassiva

    Kreassiva3 сарын өмнө

    Go vegan. Stop facilitating the creation of human made violence.

  79. Kreassiva

    Kreassiva3 сарын өмнө

    If listening to this 6min video is hard, imagine watching that content for 6 hours a week...

  80. Romeo Timeex S Bat og Jr II

    Romeo Timeex S Bat og Jr IIСарын өмнө

    6 hours a week? imagine the moderators in the Philippines they 40hrs a week.

  81. artem44

    artem443 сарын өмнө

    lol no big deal, try working in Poland if you want low payment and long term health problems

  82. Selah R.

    Selah R.3 сарын өмнө

    Speaking as a trauma therapist- It’s not like alcoholism, it’s like being a kid growing up in a home with an abusive parent who abuses and terrorizes everyone else in the home in plain sight... that even though they aren’t directly physically contacting your body, your brain and your body’s stress systems react to the stimuli. The brain does a really poor job of understanding the difference between what is happening in your immediate environment versus what you’re being exposed to vicariously through technology... the same way memories, triggers, smells, etc. can set off intense reactions/flashbacks. Moderating intensely harmful content shouldn’t be a daily task, 1-2 hours on one day a week is probably the max a healthy employee can tolerate and have the ability to sustain without resorting to unhealthy coping skills (dissociation, substance abuse, absenteeism, self-harm, disordered mood states, etc.). Speaking as a social media user- As much as computer-based content moderating systems make mistakes and irritate many users, it’s important to hear stories like this to understand that those systems are required to reduce the life-long damage this job does to employees. It’s an imperfect system either way to rely too much on humans or too much on computers, but if we have to err we need to err on the side that protects the human employees. Thank you for covering this important topic and for giving content moderators a chance to speak out honestly about the pressure and harm they deal with.

  83. ImaginebySzP

    ImaginebySzP3 сарын өмнө

    Pardon my French Daisy... BULSHIT is relevant to relevant people (as much as I don't like google/or apple/or microsoft/or...).

  84. BloodyIron

    BloodyIron3 сарын өмнө

    Yet another example of modern corporatism under paying for critical jobs

  85. Big Benzy

    Big Benzy3 сарын өмнө

    Waa Waa you're so soft, just do your job.

  86. dtox

    dtox3 сарын өмнө

    Verge: "We altered the audio" Anonymous person: "Do you want to play a game?"

  87. Dean

    Dean3 сарын өмнө

    "Wahhh I hate my job but I also refuse to quit. Wahhhh"

  88. NathanDrake

    NathanDrake3 сарын өмнө

    Im a spam reporter, im an internet helper, your welcome

  89. Tristan White

    Tristan White3 сарын өмнө

    So what is the solution? No money is enough. Google has sleep pods and paid leave, therapy and is rolling in perks and that wasn't enough. Should this position just not exist? It sounds like no one should do this job but apparently "it has to get done."

  90. Chris Donovan

    Chris Donovan3 сарын өмнө

    I wonder if they are simply pulling videos off, or reporting them to the proper authorities. If I knew that I was part of a process to STOP these acts, I would feel better about doing the work; otherwise I would feel powerless.

  91. lobeoteu

    lobeoteu3 сарын өмнө

    @Google @MNgos