Tesla Full Self-Driving was examined by third-party testing agency AMCI and the outcome was a ridiculous 13 miles between interventions.
One of many greatest issues about Tesla’s Full Self-Driving (Supervised) program is that the automaker has at all times refused to share intervention knowledge or any knowledge about this system three years into it.
Now we have to depend on anecdotal proof and crowdsourced knowledge, which Tesla CEO Elon Musk gave some credibility to by commenting positively on it regardless of it being moderately dangerous.
For instance, the greater than 14,000 miles of crowdsourced knowledge for FSD v12.5.1 variations present 31 miles between disengagement and 174 miles between essential disengagement:
Now, we get some extra unbiased testing from AMCI Testing, an unbiased automotive testing agency.
AMCI drove greater than 1,000 miles on FSD 12.5.1 and 12.5.3 in a 2024 Mannequin 3 Efficiency with {Hardware} 4 in numerous driving environments.
The outcomes are even worse than a lot of the FSD critiques thought. AMCI is reporting over 75 interventions or as soon as each 13 miles on common:
Whereas spectacular for a uniquely camera-based system, AMCI testing’s analysis of Tesla FSD uncovered how typically human intervention was required for secure operation. The truth is, our drivers needed to intervene over 75 occasions throughout the analysis; a median of as soon as each 13 miles.
The corporate shared a video sequence of a number of the most spectacular strikes by Tesla’s system and a few of its fails:
After its testing, AMCI admits that Tesla’s FSD system is spectacular, however it additionally warns that the awe that you simply get from first making an attempt it could result in complacency, which will be harmful.
Man Mangiamele, Director of AMCI Testing, explains:
“It’s plain that FSD 12.5.1 is spectacular, for the huge array of human-like responses it does obtain, particularly for a camera-based system. However its seeming infallibility in anybody’s first 5 minutes of FSD operation breeds a way of awe that unavoidably results in harmful complacency. When drivers are working with FSD engaged, driving with their fingers of their laps or away from the steering wheel is extremely harmful. As you will note within the movies, probably the most essential moments of FSD miscalculation are split-second occasions that even skilled drivers, working with a check mindset, should deal with catching.”
Mangiamele provides:
“What’s most disconcerting and unpredictable is that you could be watch FSD efficiently negotiate a particular situation many occasions – typically on the identical stretch of street or intersection – solely to have it inexplicably fail the subsequent time. Whether or not it’s a scarcity of computing energy, a difficulty with buffering because the automobile will get ”behind” on calculations, or some small element of surrounding evaluation, it’s not possible to know. These failures are probably the most insidious. However there are additionally steady failures of easy programming inadequacy, similar to solely beginning lane modifications towards a freeway exit a scant tenth of a mile earlier than the exit itself, that handicaps the system, and casts doubt on the general high quality of its base programming.”
AMCI says that one other sequence of movies from its first 1,000 miles on FSD will probably be launched subsequent week, and it plans to check future updates.
Earlier this week, I had my first drive of Tesla FSD v12.5.2, and I had comparable outcomes to these described by the corporate right here.