Snapchat's AI flagged a private message sent to 3 people and alerted the FBI in under an hour, leading to a student teacher's arrest.

Sixty minutes. That’s how long it took for a private Snapchat message to travel from Kristen Volpe’s phone to the FBI to the deputies standing in her elementary school hallway. On January 29, 2025, the 22-year-old student teacher at John L. Hensey Elementary in Washington, Illinois, vented to her boyfriend and two roommates — three people total — after a student closed her laptop mid-class and wiped her lesson plan. She referenced shooting the student or the school. She meant it as a frustrated joke. Snapchat’s algorithm didn’t get the humor.

No student reported her. No parent. No coworker. The flag was entirely automated. Snapchat’s policy permits voluntary emergency disclosures to law enforcement — no warrant required — when the platform determines imminent harm exists. The algorithm makes that initial call. Think of it like your Ring doorbell deciding to call 911 on its own, except the doorbell is reading your text messages.

  • 0x0@lemmy.zipEnglish
    5·
    2 days ago

    but if you live in a democratic country with courts and presumption of innocence until proven guilty yadda-yadda,

    So not Murica.

    • belochka@lemmy.worldEnglish
      1·
      4 hours ago

      Compared to Russia it is, but there’s a lower threshold to start having rights, expressed in money you have to spend on lawyers.

      In case of Russia no amount of money is enough to make it democratic and lawful even in some separate, specific, one can even say - personal, situation.

      It’s the fallacy of “if it’s bad here, that means that other bad place is similarly bad”, no, that other bad place is an order of magnitude worse, but you are refusing to accept that due to lack of experience. And there’s “worse” someplace else. In many other places, actually.