At CES I had the opportunity to sit down with OCZ's CEO, Ralph Schmitt, to discuss the state of OCZ after Toshiba acquired the company in late 2013. We talked about how the company has changed and evolved under the new ownership and how Toshiba has brought in some much needed NAND supply and expertise. In the article we posted summarizing that discussion I also mentioned that I would be taking a closer look at OCZ's manufacturing and validation in the coming months, and today's article focuses on that.  

OCZ flew me out to Taiwan to get an in-person look at the factory and I had Jason Ruppert, Senior Vice President of Operations, and Jim Van Patten, Vice President of World Wide Quality, as my hosts and guides throughout the trip, and a big thanks to both of them. A bit of background, to ensure these were the people to speak to: Mr. Ruppert has been with OCZ since March 2012 and before joining OCZ he was the Vice President of Manufacturing Operations & Engineering at Harmonic Inc, which focuses on video delivery infrastructures. Mr. Van Patten was actually Mr. Ruppert's first hire and joined the company in May 2012 from Logitech where he was the Vice President of World Wide Quality Assurance. Mr. Ruppert holds a Master's degree in Systems Engineering from North Carolina State University (for your interest, Anand did his BS in Computer Engineering in the same university), while Mr. Van Patten received his Ph.D. in Instructional Design & Evaluation from Syracuse University. It goes without saying that both Mr. Ruppert and Mr. Van Patten have extensive knowledge and experience within their operational areas, so the two were the best people to guide me through the manufacturing and validation.

The Development Process of an SSD

Before we move on to the actual factory tour and see how SSDs are made, let's outline the development process first. After all, a product must be designed and developed before it can be manufactured and there are some items that show up in both development and manufacturing processes. 

As with any product, the development process starts from an idea, which can be practically anything (completely new model, refresh of existing model with new NAND, higher capacity model, different form factor, new software etc.). In phase zero the idea is shaped to become a concept and usually results in a short (1-2 pages) document that describes the opportunity presented by the product. 

Once the concept is clear, the marketing and engineering teams will give their initial feedback. Both are very important because a product must be marketable, but at the same time it needs viable to execute from the engineering standpoint. Normally phase one takes about three weeks and results in a more in-depth description of the opportunity, and if it fails at this point it is either scrapped or moved back to a concept stage.

In phase two, OCZ starts to commit more significant resources to the project. The first two phases merely outline the concept and determine its opportunity, so phase three begins the actual planning of the product. The two key documents that are finalized in this phase are the marketing requirements and engineering response documents, but each function group (e.g. quality and supply chain) will also deliver their support plans. Basically, the purpose of phase two is to construct a comprehensive project plan that includes all aspects and teams involved in the product, including the budget.

Phase two is probably the most critical phase because the project plan and budget are used to decide whether OCZ puts hundreds of thousands (or even millions) of dollars behind the product, so all documents must be carefully made and evaluated in order to make the best decision for the company. The length of phase two depends on the complexity of the product and what teams need to be involved, but it typically takes from one to three months to build the final plan and budget.

If the project is funded, OCZ moves to phase three, which is where most of the engineering work is done. OCZ of course wants to keep the exact details of this phase close to its chest, but the ultimate goal is to build the first working prototypes, so the project can move to testing the prototypes. While the engineers are busy with their work, the remaining teams work on their own functions and prepare to manufacture the pilot samples (this includes tasks such as qualifying suppliers, securing long lead time parts, developing preliminary spec sheets and marketing materials). The length of the design and implementation phase depends greatly on the product, but even a drive that uses an existing controller can spend up to a year in this phase. The development of a totally new controller like the JetExpress is obviously a multi-year project given the sheer amount of engineering work required.

The Validation Phase

Phase four, which is validation and qualification, essentially consists of three main parts: the Engineer Verification Test (EVT), the Design Verification Test (DVT) and the Production Verification Test (PVT). EVT is run on the first engineering prototypes and it tests that the drive works in real life as it was designed to work on paper. The test suite is relatively straightforward and tests aspects such as power levels, signals and interface timings to ensure that the prototype works as it was planned to. There is also some preliminary performance testing in EVT phase, but because the firmware is usually far from final the results almost never illustrate the performance of a final product.

DVT is further broken down to two areas: normal DVT and quality/reliability. The normal DVT has a broader set of tests than EVT and more variables (e.g. power, temperature and host variations) are added to the mix to ensure that the drive operates and performs as it was supposed to in a variety of environments. Each test is also run on at least four samples, whereas the initial EVT testing is usually performed on just one or two samples. I'm not going to list and describe every individual test here because the DVT phase consists of dozens of different tests, but there are product compliance, data retention, power loss and die failure tests to mention a few, along with thorough performance testing to evaluate the firmware.

The reason why DVT is split into two parts is because EVT and normal DVT are both performed by the engineering team (who also designed the drive), which can create conflicts of interest during the validation process (in the end, human beings tend to be blind to their own faults and mistakes). Most of the DVT tests are rerun as reliability tests, but in this case the tests are performed by the independent quality team that is lead by Mr. Van Patten. The number of samples is also considerably higher and each test is run for a longer duration to verify the reliability of the design. Again, the full list of tests is several pages long, but aspects such as durability against vibration, shocks and low/high temperatures are tested in addition to the normal DVT tests. Basically every spec that is mentioned in the spec sheet is tested in this phase, including all standard JEDEC tests and certifications. 

The first level of PVT tests are also run later during phase four and focus on the reliability and repeatability of the manufacturing process. Basically, the purpose of the PVT tests is to ensure that every drive coming out of the mass production line will be of the same quality and that is done by examining the drives from the production line using dye-and-pry and x-ray to inspect the PCB for any defects caused by the soldering process. The other PVT tests evaluate the readiness of the factory's quality system (incoming and in-process quality inspection, final quality control and out of box inspection) to make sure that all quality control phases are capable of separating good and bad, and that no defective products will get through to the customers. Ongoing Reliability Testing (ORT) is also set up to test a few drives from every production run to guarantee that nothing changes over time. 

The total length of the validation phase varies greatly. It can be as short as two months if the design is relatively simple and similar to previous ones, but it can easily take over six months for more complex ones. Usually OCZ creates 2-5 sets of engineering samples during validation as issues are found and fixed, but there isn't really any preset duration for validation -- it always depends on what is found during the verification and how significant modifications are needed. Ultimately a drive cannot move to the next phase until it passes all quality and reliability tests, so setting a strict deadline would be a bad idea (for the company and for consumers) to begin with. 

Entering Production

In phase five the drive moves from engineering and verification to operations (i.e. manufacturing), which usually takes 3-6 weeks to complete. Final PVT tests are conducted to ensure that the manufacturing quality meets the specifications and that necessary tests are in place to spot any changes/errors in the production. Other teams also finish up their actions to be ready for the launch and this is also the point when OCZ contacts us and other media about an upcoming product launch and sends out the review samples (i.e. the samples we get are typically manufacturing pilots as the mass production hasn't begun yet). 

When the manufacturing side is ready to start putting out the new drive, a public announcement of the new product is made and the mass production as well as shipments to customers begin. As part of this visit, we had an inside look into the mass production side of the equation.

The Factory & Assembling an SSD
POST A COMMENT

64 Comments

View All Comments

  • Murloc - Wednesday, May 20, 2015 - link

    lol come on they visited other factories too....
    This article is neutral.
    Reply
  • jihe - Wednesday, May 20, 2015 - link

    You forgot Step 0 in the process: stockpile C-grade discarded nand chips from Micron/Intel/Samsung. Reply
  • valinor89 - Wednesday, May 20, 2015 - link

    The point of being owned by Toshiba is precisely to avoid having to do that. Reply
  • ocz_tuff_bunny - Wednesday, May 20, 2015 - link

    Hi jihe,
    Since this is my first comment in regards to this article please allow me to identify myself as an OCZ representative. Thank you for your comment. Being apart of a Toshiba Group Company all of our drives leverage premium Toshiba NAND. In the past few years we made significant upgrades in our products and processes to improve quality and continue to make investments in this area.
    Reply
  • sor - Thursday, May 21, 2015 - link

    This would surprise me. I've worked for memory manufacturers in the past, and you'll often find Samsung chips on Micron memory modules, and vice versa, simply because a company might choose to sell their die into more lucrative channels, or focus on manufacturing more lucrative configurations, or fulfill more lucrative contracts with the capacity they have. Then they supplement with product from competing manufacturers on their own products. People who pay attention to such things are occasionally surprised to see it, but in business its the bottom line that counts, and if you can make $.50 more per part by putting a configuration that you don't need internally on your wafers, and source your internal needs cheaper elsewhere, then you do it. Reply
  • Kristian Vättö - Thursday, May 21, 2015 - link

    In the DRAM industry it's true that the original manufacturer of the chips varies more, but on the other hand nobody claims to use brand X chips in their modules (it's always just the speed and latency that are reported). In SSDs it's different as manufacturers specifically state what NAND they use, so switching from one NAND to another would be misleading marketing (and we've had some do that in the past, which lead to ugly results). Another thing is that SSD performance depends highly on NAND, so switching the chips inside would lead to varying performance unlike in DRAM. Reply
  • jihe - Thursday, May 21, 2015 - link

    Well, will you promise to use Grade A Toshiba NANDs only then? Because OCZ had been one of the worse offenders of switching to terrible NAND chips in their SSD's, often within the same model and without any disclosure to the consumer. I would go as far as saying OCZ were using bait and switch tactics. Given your history it would take a lot to sway public sentiment. Perhaps having a NAND chip guarantee would go some way in correcting that. Reply
  • dgingeri - Wednesday, May 20, 2015 - link

    I'm quite surprised by their firmware install process. I thought it would be more automated and part of the QA process. I also thought they would have automated the stickers long before now. Reply
  • Wwhat - Wednesday, May 20, 2015 - link

    Many factories have such a weird final hand-done step. I think it's just so people have a job.
    And although that's fine, I think it does show the flaws in the capitalist system and the society's thinking.
    Reply
  • jimjamjamie - Wednesday, May 20, 2015 - link

    "..running some sort of a Linux distro.."

    If you zoom in on the photo you can see that the applications menu button (top left) has a Fedora logo. Interesting choice!
    Reply

Log in

Don't have an account? Sign up now