Was this AI trained on an unbalanced data set? (Only black folks?) Or has it only been used to identify photos of black people? I have so many questions: some technical, some on media sensationalism

  • nieceandtows@programming.dev
    link
    fedilink
    arrow-up
    1
    ·
    1 year ago

    I don’t think this is some systematic racism. Rather, it’s the technology itself that’s lacking. I remember even those motion activated bathroom sinks had problem working well with black hands. I think they’re just not good enough at differentiating between darkness and black skin.

    • lntl@lemmy.mlOP
      link
      fedilink
      arrow-up
      2
      ·
      1 year ago

      I think it is come systematic racism. AI didn’t arrest this person, police officers did. They did no further investigation before making the arrest because they didn’t have to: the person has black skin. Case closed.

    • cobra89@beehaw.org
      link
      fedilink
      arrow-up
      2
      ·
      edit-2
      1 year ago

      IMO, the fact that the models aren’t accurate with people of color but they’re putting the AI to use for them anyway is the systemic racism. If the AI were not good at identifying white people do we really think it would be in active use for arresting people?

      It’s not the fact that the technology is much much worse at identifying people of color that is the issue, it’s the fact that it’s being used anyway despite it.

      And if you say "oh, they’re just being stupid and didn’t realize it’s doing that " then it’s egregious that they didn’t even check for that.

    • vrighter@discuss.tchncs.de
      link
      fedilink
      arrow-up
      1
      ·
      1 year ago

      haha this is reminding me of an episode of Better off Ted, where they replaced all sensors with optical based ones that did not recognize black people. Their solution was to hire white guys to follow them around to open doors and turn on lights for them

      • nieceandtows@programming.dev
        link
        fedilink
        arrow-up
        0
        ·
        1 year ago

        Just because it can be doesn’t mean that’s the first place we go to. Stupidity is more likely than maliciousness and all that.

        • Fish "Id" Wardrobe@mastodon.me.uk
          link
          fedilink
          arrow-up
          0
          arrow-down
          1
          ·
          1 year ago

          @nieceandtows ::gestures at mankind’s enormously long and complex history of systemic racism::

          People are going to read your post and assume that you are apologising for the police *because* they are the police. You know, one of those “they must have done something wrong or the police wouldn’t have arrested them” people.

          I’m sure you’re not one of those. Just saying how it looks.