this post was submitted on 24 Aug 2023
382 points (94.8% liked)

Technology

58108 readers
4981 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

Driverless cars worse at detecting children and darker-skinned pedestrians say scientists::Researchers call for tighter regulations following major age and race-based discrepancies in AI autonomous systems.

top 50 comments
sorted by: hot top controversial new old
[–] angelsomething@lemmy.one 63 points 1 year ago

Easy solution is to enforce a buddy system. For every black person walking alone at night must accompanied by a white person. /s

[–] Rinox@feddit.it 38 points 1 year ago (2 children)

Isn't that true for humans as well? I know I find it harder to see children due to the small size and dark skinned people at night due to, you know, low contrast (especially if they are wearing dark clothes).

Human vision be racist and ageist

Ps: but yes, please do improve the algorithms

[–] tony@lemmy.hoyle.me.uk 2 points 1 year ago

Part of the children problem is distinguishing between 'small' and 'far away'. Humans seem reasonably good at it, but from what I've seen AIs aren't there yet.

Yeah This probably accounts for 90% of the issue.

[–] reddig33@lemmy.world 38 points 1 year ago (3 children)

LiDAR doesn’t see skin color or age. Radar doesn’t either. Infra-red doesn’t either.

[–] drz@lemmy.ca 40 points 1 year ago (4 children)

LiDAR, radar and infra-red may still perform worse on children due to children being smaller and therefore there would be fewer contact points from the LiDAR reflection.

I work in a self driving R&D lab.

[–] EatBeans@lemmy.world 2 points 1 year ago

Would you be willing to share some neato stuff about your job with us?

load more comments (3 replies)
[–] quirk_eclair78@lemmy.world 7 points 1 year ago (1 children)

That's a fair observation! LiDAR, radar, and infra-red systems might not directly detect skin color or age, but the point being made in the article is that there are challenges when it comes to accurately detecting darker-skinned pedestrians and children. It seems that the bias could stem from the data used to train these AI systems, which may not have enough diverse representation.

[–] bassomitron@lemmy.world 14 points 1 year ago

The main issue, as someone else pointed out as well, is in image detection systems only, which is what this article is primarily discussing. Lidar does have its own drawbacks, however. I wouldn't be surprised if those systems would still not detect children as reliably. Skin color wouldn't definitely be a consideration for it, though, as that's not really how that tech works.

[–] squaresinger@feddit.de 1 points 1 year ago (1 children)

Do lidar and infrared work equally on white and black people? Both are still optical systems, and I don't know how well black people reflect infrared light.

[–] fubo@lemmy.world 6 points 1 year ago* (last edited 1 year ago) (1 children)

Seriously no pun intended: infrared cameras see black-body radiation, which depends on the temperature of the object being imaged, not its surface chemistry. As long as a person has a live human body temperature, they're glowing with plenty of long-wave IR to see them, regardless of their skin melanin content.

load more comments (1 replies)
[–] OrdinaryAlien@lemm.ee 23 points 1 year ago* (last edited 1 year ago)

DRIVERLESS CARS: We killed them. We killed them all. They're dead, every single one of them. And not just the pedestmen, but the pedestwomen and the pedestchildren, too. We slaughtered them like animals. We hate them!

[–] 666dollarfootlong@lemmy.world 20 points 1 year ago (2 children)

Wouldn't good driverless cars use radars or lidars or whatever? Seems like the biggest issue here is that darker skin tones are harder for cameras to see

[–] MSids@lemmy.sdf.org 9 points 1 year ago (1 children)

Tesla removed the LiDAR from their cars, a step backwards if you ask me.

[–] dx1@lemmy.world 3 points 1 year ago (1 children)

Seems like Tesla is really not going to be the market leader on this. IDK if anytime else caught those videos by the self driving tech expert going through all the ways Tesla is bullshitting about it.

[–] Blackmist@feddit.uk 3 points 1 year ago

Hey, they'll have full self driving tech next year!

Source: Elon Musk, every year, for like the last ten years.

[–] mint_tamas@lemmy.world 2 points 1 year ago

I think many driverless car companies insist on only using cameras. I guess lidars/radars are expensive.

[–] tonytins@pawb.social 17 points 1 year ago (7 children)

Maybe if we just, I dunno, funded more mass transit and made it more accessible? Hell, trains are way better at being automated than any single car.

[–] fushuan@lemm.ee 2 points 1 year ago

Yes, but also improve kid and dark skin people detection tools, they don't work just for driving cars. Efficient, fast and accurate people detection and tracking tools can be used in other myriad of stuff.

Imagine a system that tracks the amount of people in different sections of the store, a system that checks the amount of people going in and out of stores to control how many are inside... There's a lot of tools that already do this, but and they works somewhat reliably, but they can be improved, and the models being developed for cars will then be reused. I+D is a good thing.

load more comments (6 replies)
[–] dangblingus@lemmy.dbzer0.com 15 points 1 year ago

I'm sick of the implication that computer programmers are intentionally or unintentionally adding racial bias to AI systems. As if a massive percentage of software developers in NA aren't people of color. When can we have the discussion where we talk about how photosensitive technology and contrast ratio works?

[–] macrocephalic@lemmy.world 12 points 1 year ago (3 children)

Self driving cars are republicans?

[–] squaresinger@feddit.de 2 points 1 year ago

Built by them, inherited their biases.

They just want to do abortions on the road. Just a few years after birth.

load more comments (2 replies)
[–] RobotToaster@infosec.pub 9 points 1 year ago* (last edited 1 year ago)

The study only used images and the image recognition system, so this will only be accurate for self driving systems that operate purely on image recognition. The only one that does that currently is Tesla AFAIK.

[–] jhoward@lemmy.sdf.org 7 points 1 year ago

Probably could have stopped that headline at the third word.

[–] camillaSinensis@reddthat.com 6 points 1 year ago (2 children)

I'd assume that's either due to bias in the training set, or poor design choices. The former is already a big problem in facial recognition, and can't really be fixed unless we update datasets. With the latter, this could be using things like visible light for classification, where the contrast between target and background won't necessarily be the same for all skin tones and times os day. Cars aren't limited by DNA to only grow a specific type of eye, and you can still create training data from things like infrared or LIDAR. In either case though, it goes to show how important it is to test for bias in datasets and deal with it before actually deploying anything...

In this case it's likely partly a signal to noise problem that can't be mitigated easily. Both children and dark skinned people produce less signal to a camera because they reflect less light. children because they're smaller, and dark skinned people because their skin tones are darker. This will cause issues in the stereo vision algorithms that are finding objects and getting distance to them. Lidar would solve the issue, but companies don't want to use it because lidars with a fast enough update rate and high enough resolution for safe highway driving are prohibitively expensive for a passenger vehicle (60k+ for just the sensor)

[–] jimbolauski@lemmy.world 2 points 1 year ago

Darker toned people are harder to detect because they reflect less light. The tiny cheap sensors on cameras do not have enough aperture for lower light detections. It's not training that's the problem it's hardware.

[–] Darkassassin07@lemmy.ca 6 points 1 year ago (4 children)

This has been the case with pretty much every single piece of computer-vision software to ever exist....

Darker individuals blend into dark backgrounds better than lighter skinned individuals. Dark backgrounds are more common that light ones, ie; the absence of sufficient light is more common than 24/7 well-lit environments.

Obviously computer vision will struggle more with darker individuals.

[–] Rivalarrival@lemmy.today 5 points 1 year ago (1 children)
[–] OrdinaryAlien@lemm.ee 2 points 1 year ago

Visible light: (͡•_ ͡• )

load more comments (3 replies)
[–] ChromeSkull@lemmy.world 5 points 1 year ago (1 children)

A single flir camera would help massively. They don't care about colour or height. Only temperature.

[–] UsernameIsTooLon@lemmy.world 2 points 1 year ago

I could make a warm water balloon in the shape of a human and it would stop the car then. Maybe a combination of all various types of technologies? You'd still have to train the model on all various kinds of humans though.

[–] Dave@lemmy.nz 5 points 1 year ago (4 children)

Weird question, but why does a car need to know if it's a person or not? Like regardless of if it's a person or a car or a pole, maybe don't drive into it?

Is it about predicting whether it's going to move into your path? Well can't you just just LIDAR to detect an object moving and predict the path, why does it matter if it's a person?

[–] duffman@lemmy.world 2 points 1 year ago (1 children)

They need to safely ignore shadows, oil stains on the road, just because there's contrast on an image doesn't mean it's an object.

[–] Dave@lemmy.nz 1 points 1 year ago (1 children)

Sure but why on earth are we relying on cameras to drive cars? Many modern cars have radar, which is far more reliable.

[–] duffman@lemmy.world 2 points 1 year ago

Natural vision is awesome, it works for billions of humans. We just have nothing close to what the human eyes and brain offers in terms of tech in that spectrum.

I think it needs to be a combination of sensors since radar sucks in the rain/snow/fog.

[–] RobotToaster@infosec.pub 2 points 1 year ago

Cameras and image recognition are cheaper than LIDAR/RADAR, so Tesla uses it exclusively.

load more comments (2 replies)
[–] Aopen@discuss.tchncs.de 4 points 1 year ago (1 children)

Im not expert, but perhaps thermal camera + lidar sensor could help.

load more comments (1 replies)
[–] covert_czar@lemmy.dbzer0.com 3 points 1 year ago

#blacklivesmatter

[–] Double_A@discuss.tchncs.de 1 points 1 year ago

Damn ageist AI!

load more comments
view more: next ›