The U.S. government’s road safety agency is again investigating Tesla’s “Full Self-Driving” system, this time after getting reports of crashes in low-visibility conditions, including one that killed a pedestrian.
The National Highway Traffic Safety Administration says in documents that it opened the probe on Thursday with the company reporting four crashes after Teslas entered areas of low visibility, including sun glare, fog and airborne dust.
In addition to the pedestrian’s death, another crash involved an injury, the agency said.
Investigators will look into the ability of “Full Self-Driving” to “detect and respond appropriately to reduced roadway visibility conditions, and if so, the contributing circumstances for these crashes.”
Tesla, which has repeatedly said the system cannot drive itself and human drivers must be ready to intervene at all times.
how is it legal to label this “full self driving” ?
If it took them this long to look at Full Self Driving, I don’t have a lot of hope. But I’d like to be pleasantly surprised.
National Highway Traffic Safety Administration is now definitely on Musk’s list of departments to cut if Trump makes him a high-ranking swamp monster
Why do you think musk dumping so much cash to boost Trump? The plan all along is to get kickbacks like stopping investigation, lawsuits, and regulations against him. Plus subsidies.
Rich assholes don’t spend money without expectation of ROI
He knows Democrats will crack down on shady practices so Trump is his best bet.
He’s not hoping for a kickback, he is offered a position as secretary of cost-cutting.
He will be able to directly shut down everything he doesn’t like under the pretense of saving money.
Trump is literally campaigning on the fact that government positions are up for sale under his admin.
“I’m going to have Elon Musk — he is dying to do this… We’ll have a new position: secretary of cost-cutting, OK? Elon wants to do that,” the former president said"
Humans know to drive more carefully in low visibility, and/or to take actions to improve visibility. Muskboxes don’t.
They also decided to only use cameras and visual clues for driving instead of using radar, heat cameras or something like that as well.
It’s designed to be launched asap, not to be safe
I mean, that’s just good economics. I’m willing to bet someone at Tesla has done the calcs on how many people they can kill before it becomes unprofitable
I’m not so sure. Whenever there’s crappy weather conditions, I see a ton of accidents because so many people just assume they can drive at the posted speed limit safely. In fact, I tend to avoid the highway altogether for the first week or two of snow in my area because so many people get into accidents (the rest of the winter is generally fine).
So this is likely closer to what a human would do than not.
low visibility, including sun glare, fog and airborne dust
I also see a ton of accidents when the sun is in the sky or if it is dusty out. \s
Yup, especially at daylight savings time when the sun changes position in the sky abruptly.
Cameras are probably worse here, but they may be able to make up for it with parallel processing the poor data they get.
Muskboxes
like that
Humans know to drive more carefully in low visibility…Muskboxes don’t.
They do, actually. It even displays a message on the screen about low visibility.
Eyes can’t see in low visibility.
musk “we drive with our eyes, cameras are eyes. we dont need LiDAR”
FSD kills someone because of low visibility just like with eyes
musk reaction -
The whole “we drive with our eyes” thing is such bullshit. Humans are terrible drivers. Autonomous driving should be better than humans.
That goes for OpenPilot too. They actually openly advertise that their software makes the same mistakes as humans, as if it’s some sort of advancement. Like if I could plug Lidar into my brain, I totally would.
It’s worse than that, though. Our eyes are significantly better than cameras (with some exceptions at the high end) at adapting to varied lighting conditions than cameras are. Especially rapid changes.
if he was truthful: “the cost of adding lidar cuts in my profits”
Correction - Older Teslas had lidar, Musk demanded they be removed because they cut into his profits. Not a huge difference but it does show how much of a shitbag he is.
Honestly though, I’m a fucking idiot and even I can tell that Lidar might be needed for proper, safe FSD
What pisses me off about this is that, in conditions of low visibility, the pedestrian can’t even hear the damned thing coming.
I hear electric cars all the time, they are not much quieter than an ice car. We don’t need to strap lawn mowers to our cars in the name of safety.
How Can Cameras Be Real If Our Eyes Aren’t Real?
You’d think “we drive with our eyes, cameras are eyes.” is an argument against only using cameras but that do I know.
If anyone was somehow still thinking RoboTaxi is ever going to be a thing. Then no, it’s not, because of reasons like this.
It doesn’t have to not hit pedestrians. It just has to hit less pedestrians than the average human driver.
It does, actually. That’s why robotaxis and self-driving cars in general will never be a thing.
Society accepts that humans make mistakes, regardless of how careless they’re being at the time. Autonomous vehicles are not allowed the same latitude. A single pedestrian gets killed and we have to get them all off the road.
The average human driver is tried and held accountable
Exactly. The current rate is 80 deaths per day in the US alone. Even if we had self-driving cars proven to be 10 times safer than human drivers, we’d still see 8 news articles a day about people dying because of them. Taking this as ‘proof’ that they’re not safe is setting an impossible standard and effectively advocating for 30,000 yearly deaths, as if it’s somehow better to be killed by a human than by a robot.
The problem with this way of thinking is that there are solutions to eliminate accidents even without eliminating self-driving cars. By dismissing the concern you are saying nothing more than it isn’t worth exploring the kinds of improvements that will save lives.
If you get killed by a robot, it simply lacks the human touch.
If you get killed by a robot, you can at least die knowing your death was the logical option and not a result of drunk driving, road rage, poor vehicle maintenance, panic, or any other of the dozens of ways humans are bad at decision-making.
or a flipped comparison operator, or a “//TODO test code please remove”
It doesn’t even need to be logical, just statistically reasonable. You’re literally a statistic anytime you interact w/ any form of AI.
It needs to be way way better than ‘better than average’ if it’s ever going to be accepted by regulators and the public. Without better sensors I don’t believe it will ever make it. Waymo had the right idea here if you ask me.
But why is that the standard? Shouldn’t “equivalent to average” be the standard? Because if self-driving cars can be at least as safe as a human, they can be improved to be much safer, whereas humans won’t improve.
I’d accept that if the makers of the self-driving cars can be tried for vehicular manslaughter the same way a human would be. Humans carry civil and criminal liability, and at the moment, the companies that produce these things only have nominal civil liability. If Musk can go to prison for his self-driving cars killing people the same way a regular driver would, I’d be willing to lower the standard.
Sure, but humans are only criminally liable if they fail the “reasonable person” standard (i.e. a “reasonable person” would have swerved out of the way, but you were distracted, therefore criminal negligence). So the court would need to prove that the makers of the self-driving system failed the “reasonable person” standard (i.e. a “reasonable person” would have done more testing in more scenarios before selling this product).
So yeah, I agree that we should make certain positions within companies criminally liable for criminal actions, including negligence.
That is the minimal outcomes for an automated safety feature to be an improvement over human drivers.
But if everyone else is using something you refused to that would have likely avoided someone’s death, while misnaming you feature to mislead customers, then you are in legal trouble.
When it comes to automation you need to be far better than humans because there will be a higher level of scrutiny. Kind of like how planes are massively safer than driving on average, but any incident where someone could have died gets a massive amount of attention.
Does anyone else find this enraging ?
It’s a decade too late.
I thought it was illegal to call it full self driving? So I thought Tesla had something new.
Apprently it’s the moronic ASSISTED full self driving the article is about. So nothing new.
Tesla does not have a legal full self driving system, so why do articles keep pushing the false narrative, even after it’s deemed illegal?I thought it was illegal to call it full self driving?
Courts have already ruled the opposite.
why do articles keep pushing the false narrative
Because that’s what it’s called.
so why do articles keep pushing the false narrative, even after it’s deemed illegal?
The same reason that simple quadcopters have been deemed by the press to be called “drones”. You can’t manufacture panic and outrage with a innocuous name.
Assisted full self driving is an oxymoron.
It was called that name at the time when the kills happened.
Investigators will look into the ability of “Full Self-Driving” to “detect and respond appropriately to reduced roadway visibility conditions
They will have to look long and hard…
Maybe have a safety feature that refuses to engage self drive if it’s too foggy/rainy/snowy.
Inb4 someone on TikTok shows how to bypass that sensor by jamming an orange in it -__-
This is why you can’t have an AI make decisions on activities that could kill someone. AI models can’t say “I don’t know”, every input is forced to be classified as something they’ve seen before, effectively hallucinating when the input is unknown.
I’m not very well versed in this but isn’t there a confidence value that some of these models are able to output?
All probabilistic models output a confidence value, and it’s very common and basic practice to gate downstream processes around that value. This person just doesn’t know what they’re talking about. Though, that puts them on about the same footing as Elono when it comes to AI/ML.
Right, which is why that marvelous confidence value got somebody ran over.
I wonder if they will now find the Emperor has no clothes.
