this post was submitted on 15 Mar 2024
16 points (100.0% liked)

Technology

57853 readers
6718 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

Code used in the analysis is here

top 16 comments
sorted by: hot top controversial new old
[–] owenfromcanada@lemmy.world 4 points 5 months ago (2 children)

Hmm... it's almost like if you train a model on biased data you get biased results...

[–] Womble@lemmy.world 3 points 5 months ago (1 children)

I like how this statement works for both AI and human recruiters.

[–] Thorny_Insight@lemm.ee 2 points 5 months ago* (last edited 5 months ago)

As does most critizism about LLMs. We wanted one that behaves like a human and then got angry when that's exactly what it does.

[–] catloaf@lemm.ee 2 points 5 months ago

Garbage in, garbage out. Nothing new here.

[–] gedaliyah@lemmy.world 3 points 5 months ago (2 children)

How could we possibly expect that there wouldn't be bias? Is based off the patterns that humans use. Humans have bias. The difference is that humans he can recognize their bias and worked overcome it. As far as i know chat GPT can't do that.

[–] abhibeckert@lemmy.world 1 points 5 months ago* (last edited 5 months ago) (3 children)

humans he can recognize their bias

Can they? I'm not convinced.

As far as i know chat GPT can’t do that.

You do it with math. Measure how many females you have with a C level position at the company and introduce deliberate bias into hiring process (human or AI) to steer the company towards a target of 50%.

It's not easy, but it can be done. And if you have smart people working on it you'll get it done.

[–] JoBo@feddit.uk 2 points 5 months ago* (last edited 5 months ago)

You start off by claiming that humans can't recognise their biases and end up by saying that there's no problem because humans can recognise their biases so well they can programme it out of AI.

Which is it?

[–] wurosh@lemmy.ml 1 points 5 months ago

Why is 50% the target?

Just as we stopped beating our chest with fist when angry, humans can understand pattern and forcefully prevent them.

[–] Plopp@lemmy.world 1 points 5 months ago

Because they don't know what "AI" is so they think it's this technical thing that just knows things, all the things, magically. I've seen confident statements like "we use AI in our recruiting process because it has no bias!!" 🤦‍♂️

[–] Heavybell@lemmy.world 2 points 5 months ago

Racial bias in, racial bias out.

[–] backgroundcow@lemmy.world 2 points 5 months ago

"I've created this amazing program that more or less precisely mimics the response of a human to any question!"

"What if I ask it a question where humans are well known to apply all kinds of biases? Will it give a completely unbiased answer, like some kind of paragon of virtue?"

"No"

[–] Dasnap@lemmy.world 1 points 5 months ago

So it's working as expected? /s

[–] dgmib@lemmy.world 1 points 5 months ago

Job seekers next ChatGPT prompt:

Here’s a job posting and my resume, can you tell me what to change to make me sound like a perfect fit for the role?

ChatGPT:

  • Change name from “Latifa Tshabalala“ to “Kevin Smith” …
[–] Cannibal_MoshpitV3@lemmy.world 0 points 5 months ago (1 children)

I've had several bosses tell me that the moment they see a stereotypical African American name they throw out the application/resume.

Honestly that works for human recruiters too.

I have a very "Caucasian" name. For years, I had some serious confused faces during interviews, people who thought I was a great applicant on paper but then cut the meeting short because I suddenly "dont fit the culture".

I now include my photo in my application. Saves me time too, because I don't want to work at a racist ass company.