WhatsApp’s AI shows gun-wielding children when prompted with ‘Palestine’ - Feddit
feddit.de
The search results varied when tested by different users, but the Guardian verified through screenshots and its own tests that various stickers portraying guns surfaced for these three search results. Prompts for “Israeli boy” generated cartoons of children playing soccer and reading. In response to a prompt for “Israel army” the AI created drawings of soldiers smiling and praying, no guns involved. Meta’s own employees have reported and escalated the issue internally, a person with knowledge of the discussions said.
  • Pigeon@beehaw.org
    1·
    1 year ago

    Also, it’s the type of thing that makes me very worried about the fact that most of the algorithms used in things like police facial recognition software, recidivism calculation software, and suchlike are proprietary black boxes.

    There are - guaranteed - biases in those tools, whether in their processors or in the unknown datasets they’re trained on, and neither police nor journalists can actually see the inner workings of the software to know what those biases are, to counterbalance them or to recognize if the software is so biased as to be useless.