How Long Does a USB Flash Drive Last? (Part II)

We place precious data on these small electronic devices. It’s of no surprise that we wonder if it can all just disappear in the flux of electronic bits, bytes, capacitors, and transistors. It’s not easy to grasp how a USB flash drive can store all of our life’s work and keep it safe. Let’s dive in and figure out if these flash based devices can be trusted.

Just Give Me a Straight Answer

USB flash drives and SSDs are fast and increasingly reliable, and are replacing the older tapes and hard-drives. I recall from the numerous studies, articles as well as just the common understanding between the IT professionals, the average lifetime of a hard-drive was between 3-5 years. As the flash memory reduced in price, the surge of the flash drives and SSDs has increased dramatically. However, the knowledge about their endurance or the lifetime of the flash memory based devices has been lacking.

Many factors directly affect the longevity of the flash memory. Some of those factors are the quality and the type of the flash memory and the controller, and the intended use of the USB flash drive or SSD device. If you want the fastest answer without getting technical or getting bored with the details, the life of the modern USB flash drive or SSD would generally match or exceed the average lifetime of a hard-drive under moderate load – 3-5 years or more.

More Details, Please

We started the discussion on this topic in the previous post. It can be accessed here. Without knowing if there is any interest, we focused mainly on a theoretical time model of constant read/write load on the drive. It was assumed that a USB flash drive would be written to 15% of the time under 24/7 365 days a year load.

Since, this topic seems to perk the interest of a few readers, it was important to add more color into the dilemma of predicting the life and death of a flash memory device.

It’s important to understand that the quality of the flash memory as well as the logic of the flash memory controllers can affect the performance as well as the endurance of a flash memory device such as USB flash drive or SSD. The models that are presented assume that the controller can distribute the writes evenly over the flash memory, and that the quality of the flash memory itself will stand up to the promised write/erase cycles.

Below, are two models for computing the endurance of a flash based device. The first is the time model – given a specific write time each day, how much data can be written to a device and thus how long it will last. The second is the data model – given a specific data size, how long will the device last if the data size is written to the drive each day.

Flash Memory Endurance Computation-Bowtie Promotions 2013

Table Adventure or How to Follow the Endurance Numbers

All of the flash memory lifetimes are computed for the TLC type memory. This particular type memory is becoming the standard for the consumer based flash products. It has earned the clever marketing moniker cMLC.

The topmost table, as mentioned before, depicts the time based model.  The bottommost table depicts the data model. Both models assume 100,000 IOPS (Input/Output Operations per Second) for modern SSDs; 60K IOPS for older SSDs, and 2.5K IOPS for the USB flash drives. Additionally, both models assume that the SSD type flash memory is rated to 3K write/erase cycles, whereas the USB flash drive memory is rated to 1K. The actual numbers will vary; however these numbers are close enough for the modeling purposes.

On the very bottom of each table is the “Terabytes per year” measure. This number clarifies how each model differs.  In the time model, if the flash memory and the device are fast, then they will be able to write much more data in a given period of time. In the data model, time does not matter, because we are given a fixed data to write each day.

The time model assumes that we’ll be writing on average about an hour per day. In the most extreme example of the time model, given a 256GB SSD (100K IOPS rated drive), you’ll have written 469.92 Terabytes worth of data per year or 751.87 Terabytes over 1.6 years before the drive’s ultimate end. In the slowest example of the time model, given a 256GB USB flash drive (2.5K IOPS rated drive), you’ll have written only 11.75 Terabytes worth of data per year or 250.04 Terabytes over 21.28 years before the drive’s end of life.

Now the data model. You’ll notice right away that the Terabytes per year field is exactly the same for each drive. Here it does not matter how long it takes; you can have the fastest drive or the slowest. What matters is that you have a certain amount of data that you write per day. In case of our model, 1GB worth of data per day was chosen. Therefore, the written data per day will be 1GB * 365 day per year = 365GB per year or rounded 0.36 Terabytes per year.

Outstanding Endurance in USB Flash Drives for a Casual User

The time model’s results are not very appealing; however the time model is more suited for a server, professional CAD, or a audio/videophile who are constantly writing large amounts of data each day. For a casual user or a professional who does not reply on writing significant amount of data per day, the data model is much more appropriate.

The data model shows more than 40 years of life for a 16GB USB flash drive. That’s an outstanding endurance number for any electronic device. It’s comforting to know that even though it’s a tiny device, it can be trusted with many years of service for keeping the data safe.

Conclusion; Just Before You Go

Our time and data models show promising results for the SSDs and the USB flash drives. If you’ve got data to move, the flash memory provides the fastest route available today. In the time model, the life of the drive is only shortened due to the incredible amount of data being written to the drive. In the data model, the casual and some professional users can take comfort in the results. The longevity of the 256GB USB flash drive pushing 700 years is as safe as it gets.

Just before you go, only one note. As the drive fills up with data, the models need to be re-referenced. For example, if you manage to fill up half of your 16GB USB flash drive with data on the first day, you’ll only have the remaining 8GB for writing. Then it would be best to reference the endurance for the 8GB drive to get a closer approximation.

How long will your USB flash drive last? It’s much shorter than you think!

[Updated – March 2013]

Every electronic device has a set lifetime, no matter how reliable it may be. Either the mechanical components of the device fail and/or the electronics fail. It may be great news to the manufacturing companies; however not so much to us – the regular consumers.

The news of failing electronics get worse if you consider storage devices such as hard drives, SSDs, and flash memory. Drive failure frequently means loss of important data and utter disappointment.  If there is a chance or restoring the data from the backup,  it may take hours or even days.  It’s difficult to find reconciliation, unless you’re into target practice.

It’s almost impossible to reliably predict a point of time when a drive will fail. Fortunately, there are some tools to estimate an average lifetime of a storage drive. We’ll focus on the flash memory (NAND) storage in this post, and will leave the hard drives to other blogs. Keep in mind that we’ll show a relatively simple way of computing the life of an average flash drive with typical usage.

Let’s dive in! Wait… before we do; let’s go over some basics really quickly.

  1. Flash memory consists of billions of transistors. Each transistor can store from one bit to three bits
  2. The smallest data that the flash memory can read or write is 4KB worth of data. 4KB = 32768 bits
  3. The smallest data the the flash memory can erase is 512KB – that’s huge!
  4. If the data is overwritten in the flash memory, it must first be erased and only then written.
  5. Each time the data is erased, the life of the transistors involved is diminished.
  6. Each time the data is written/read, the controller on the flash drive interacts with the flash memory. That interaction is referred to as IOPS (Input/Output [operations] Per Second)

Now we can start calculating the life of your flash drive. The usual life of each transistor for erase/write cycle is about 1,000 or less. The reason it’s not higher is because the USB flash memory makers often use MLC or TLC type flash memory. From the lesson #1 above; it is the type that stores 2 and 3 bits respectively per transistor (cell).

The average write IOPS measure for a flash drive is about 2500. However, if you’re geeky enough, you can measure yours with Intel’s iometer tool.

So how do I actually get the life of my drive?!

Flash Memory Lifetime Updated

Previously, we used 256K data block in our calculation instead of intended 4K. The result was not a happy number! With this more appropriate computation, the 4GB gets a reputable 32.36 days of heavy duty usage!

The calculation assumes that 15% (that’s the 0.15 in computation) of the time you’ll be writing to the drive. That’s 15% of the 24 hours per day for those 32.36 days. Also, the calculation assumes that you’ll be overwriting (erasing and writing the data) evenly on the flash drive. These are 32.36 pure and hardcore writing days for a causal and even professional user.

Practically speaking, a lot depends on the usage of your drive and the capacity. Additionally, there is a hidden attribute – a factor of how well the controller on the flash drive distributes the writes. In any case, a 4GB drive can last many years. Increasing your capacity, increases the lifetime of your drive so it’s always a good idea to pick the largest size you can.

So what’s that magic number that is used in the formula, you ask? It’s quite simple 🙂 It’s purely used for conversion purposes. Since we use GBs in the numerator and seconds in the IOPS argument, it’s easier to use the 33.25 conversion factor to simplify computation. You get 33.25 with the following operation: 1,000 cycles X (1,048,576KB) / 31,536, 000 sec [There is 1,048,576KB in 1GB; there is 31,536,000 sec in one year]

So how long will your USB flash drive last? That really depends on many factors. However, there are few things you can remember if you want to extend the life of your drive.

  1. Buy the largest capacity you can afford.
  2. Do research. Choose SLC memory over MLC. And MLC over TLC.
  3. Avoid erasing data.
  4. Even the best technology fails; don’t forget to backup!

Armed with the information, you now can protect your investment better. Most of our valuable work is now stored on hard drives and flash memory. The flash memory is being utilized more and more due to its high speed and the lack of mechanical parts. However, there are important facts that you must know to better guard yourself from data loss.

[Update] We continue and expand our discussion on the endurance of flash memory here.

USB Flash Drive vs. Cloud Storage Infrastructure

There has been a huge amount of interest and buzz surrounding cloud computing, storage, and infrastructure. Everyone wants to be on the cloud; some because they need it and some just to be a part of the buzz.

Cloud storage is gaining ground with Google, DropBox, iDrive, Amazon, Microsoft, and many others competing for the business. The idea is quite simple – allow users to store data remotely so that it can be accessed from any device and any location in the world where there is Internet connectivity. Behind the scenes there are large data server farms that are air, heat, and vibration controlled with redundant systems that all work to maximize uptime and data reliability. For many, the Cloud storage services are invaluable tool at their disposal.

However, there are a couple downsides to the Cloud storage service, no matter how invaluable it may be. The most troubling is sending your data to companies that may harvest, analyze, and potentially borrow your data from you. “What are you talking about?”, you ask. The following excerpt is from Google Terms of Use as of March 1, 2012: “When you upload or otherwise submit content to our Services, you give Google (and those we work with) a worldwide license to use, host, store, reproduce, modify, create derivative works (such as those resulting from translations, adaptations or other changes we make so that your content works better with our Services), communicate, publish, publicly perform, publicly display and distribute such content.” Even though many say that this is the usual small print text that companies include in their terms of use, I say “It makes me very uneasy using their service when they use such language!”

Another, a much more simpler downside, is data availability. It’s ironic, however all the Cloud data is accessed over the Internet; therefore you are always at the mercy of the Internet Service Provider (ISP)  to provide the best service possible. No connectivity means that your data is safely stored in the industrial data warehouse completely out of your reach.

The ISP does not necessarily have to be blamed for connectivity issues to the Cloud. If your business has insufficient bandwidth for your employees, you may get stuck spending your time looking at the progress bar as it slowly tests your patience while opening a single document.

The USB Flash Drive is your answer! Well… maybe I am slightly biased towards the flash drives on this site. Please forgive my eagerness. The USB storage definitely has some answers, but it is not a solution for all.

The USB storage, whether it is in the SSD or a small flash drive package, offers significant simple benefits.

  1. Your data is not shared with any company and the terms of use are your own.
  2. The data can be simply secured using great encryption tools (some free and some not – your choice).
  3. Data availability is at your fingertips.

It is quite logical that USB flash drive or SSD offers simple benefits to the Cloud storage service. However, there is a downside.

  1. You need to worry about the backup (Flash memory does go bad, just like any other technology).
  2. If you loose your drive, there is no way to recover it unless you have a backup.
  3. There are no additional services for data sharing as offered by the Cloud services.

Picking a storage solution is a matter of a personal preference, a technological set of beliefs, and your specific needs and requirements. If you don’t feel threatened by the terms and conditions of the Cloud service providers and have great network connectivity, the Cloud can be the choice. If you’re a little paranoid (like me) and like to have an always available storage with no strings attached, the USB flash drive or SSD may be your answer.