Tesla Troubles: Models Bricking Over Flash Memory Problem
As the most-successful manufacturer of electric vehicles, Tesla is often at the forefront of new challenges relating to advanced automotive technologies. While the brunt of this has revolved around its software, mainly Autopilot, it’s also going to be among the first automakers to confront widespread battery recycling — something it’s already planning for at its Nevada Gigafactory.
Nothing last forever and, like every internal combustion vehicle, EVs have parts that go bad. Over the last six months, there’s been a growing number of reports of customers claiming their Teslas are bricking out like old phones. Displays are going dark, accessories are… inaccessible, and charging is often not an option. The culprit appears to be the embedded Multi-Media Controller (eMMC) on MCUv1 units, which logs data using flash memory.
Apparently, Tesla is overworking these systems (at least on some models) to a point where they can’t take it anymore. It’s basically the same thing that would happen if you filled and wiped a USB drive hundreds of times everyday. One morning you’d plug it in and find that it’s no longer functional due to being burnt out from overuse.
Coverage of the issue started to really pick up after Jason Hughes, an independent repair professional from North Carolina’s 057 Technology, managed to get Elon Musk to respond to the issue. On October 9th, he tweeted out that he had encountered dozens of “ MCUv1 units for customers suffering from eMMC flash failure,” suggesting that Tesla’s engineering team do something about it.
Musk responded that the problem should be “much better at this point.”
Hughes responded that he had seen models suffering from the problem from a version that was just a couple of weeks old, adding that he would keep an eye on newer versions.
Complaints of the flash-memory failure go back much further, however, and were gaining serious steam online as early as 2018. In May, the YouTube channel Rich Rebuilds (which is pretty good if you want an unbiased look into EVs) discussed the matter and opened up an MCUv1 to get a gander at the hardware with Phil Sadow.
“[Tesla] creates so many logs in the car, they write to [the eMMC] so fast that it basically burns them out. They have a finite amount of writes; they can only do so many writes. The amount of logging they’re doing is excessive,” Sadow explained.
InsideEVs, which has one of the most comprehensive explanations of the problem available, spoke with several of the repair professionals expressing concerns to get their opinion.
“The main issue is that this excessive log file writing causes eMMC flash wear,” explained Hughes. “Flash memory is generally only rated for some tens of thousands of write cycles. What happens is that the flash memory starts to fail when writings can no longer be completed. When one block fails, parts of the firmware may also become unreadable, leading to poor operation or failure of the MCU completely.”
Tesla Forums covered the issue back in April, with a poster noting the MCU repeatedly rebooted after 39,000 miles on their 2016 Model S. Repeated repair attempts failed to solve the issue, and they were understandably upset that they had to pay half the cost out of pocket — despite the vehicle still being under warranty. Tesla Motors Club has also covered the matter at length, with customers giving the play-by-play of their flash memory headaches.
Most owners seem to be encountering the problem very near the warranty cutoff. Those that make it technically should have their MCU replacement covered. If not, repairs can cost anywhere between $400 and $3,800 — depending on where you’re having the work done (and how they’re doing it).
Some independent shops have admitted that, while they’ve managed to find ways to replace the failed chip, reprogramming the system to not bombard itself with ever-cycling data has been harder to manage. Most units are still subject to overloading over time but some feel confident they’ve managed to sort that out in part by installing more robust memory chips or by simply sending some of those unnecessary ones and zeros to the RAM.
“Tesla needs to just disable syslog on all vehicles unless specifically required on a development car or to diagnose an infotainment issue on a specific car. There are absolutely zero reasons to log hundreds of MB per day to a small built-in flash chip,” said Hughes. “Tesla has known about this issue for years now and has done nothing to mitigate it. I’ve personally reported it on multiple occasions, and I know others have as well. I’ve noted this to Tesla on several occasions, starting in late 2015, and several times since.”
While everyone is largely concerned with MCUv1, which are logging more data than ever before, MCUv2 vehicles technically suffer from the issue as well. But their larger chip size is likely to buy the owner significantly more time, which is about all anyone outside the manufacturer can do anyway. Tesla will ultimately be the one that has to address the high amount of logging that’s ultimately creating this problem — especially for vehicles still under warranty.
“The cynic in me looks at this as a planned obsolescence type of thing,” said Hughes. “However, the reality is probably a lot more benign: laziness.”
[Image: JL IMAGES/Shutterstock]
Jkross22 on Oct 18, 2019
I tried talking my cousin out of buying one of these a few months ago, but it's what he wanted. This is really bad that Tesla cheaped out like this. We've seen them cheap out on materials and fit and finish, but the assumption (at least my assumption) was that all drivetrain/propulsion related electronics were solid. Huge black eye for Tesla. Their response is once again less than acceptable.
Art Vandelay on Oct 19, 2019
So I assume this is a confluence of issues. It looks like, per other articles there is no load leveling (trim) functionality on the drive. That combined with a high level of logging ensure the same sectors are written to over and over and frequently. Larger drives with trim implemented should Outlast the car. Not sure if they cheaper out on the memory...you want quality used in hard drives here...not the USB stick caliber stuff. Ideally though this is not a failure that should kill the car either way so I do question the implementation.
Latest Car ReviewsRead more
Latest Product ReviewsRead more
- Fahrvergnugen NA Miata goes topless as long as roads are dry and heater is running, windscreen in place.
- 3SpeedAutomatic As a side note, have you looked at a Consumers Report lately? In the past, they would compare 3 or 4 station wagons, or compact SUVs, or sedans per edition. Now, auto reporting is reduced to a report on one single vehicle in the entire edition. I guess CR realized that cars are not as important as they once were.
- Fred Private equity is only concerned with making money. Not in content. The only way to deal with it, is to choose your sites wisely. Even that doesn't work out. Just look at AM/FM radio for a failing business model that is dominated by a few large corporations.
- 3SpeedAutomatic Lots of dynamics here:[list][*]people are creatures of habit, they will stick with one or two web sites, one or two magazines, etc; and will only look at something different if recommended by others[/*][*]Generation Y & Z is not "car crazy" like Baby Boomers. We saw a car as freedom and still do. Today, most youth text or face call, and are focused on their cell phone. Some don't even leave the house with virtual learning[/*][*]New car/truck introductions are passé; COVID knocked a hole in car shows; spectacular vehicle introductions are history.[/*][*]I was in the market for a replacement vehicle, but got scared off by the current used and new prices. I'll wait another 12 to 18 months. By that time, the car I was interested in will be obsolete or no longer available. Therefore, no reason to research till the market calms down. [/*][*]the number of auto related web sites has ballooned in the last 10 to 15 years. However, there are a diminishing number of taps on their servers as the Baby Boomers and Gen X fall off the radar scope. [/*][/list]Based on the above, the whole auto publishing industry (magazine, web sites, catalogs, brochures, etc) is taking a hit. The loss of editors and writers is apparent in all of publishing. This is structural, no way around it.
- Dukeisduke I still think the name Bzzzzzzzzzzt! would have been better.