Live Long and Prosper: The Logical Page

Computers are all about abstraction. In the early days of computing you had to write assembly code to get your hardware to do anything. Programming languages like C and C++ created a layer of abstraction between the programmer and the hardware, simplifying the development process. The key word there is simplification. You can be more efficient writing directly for the hardware, but it’s far simpler (and much more manageable) to write high level code and let a compiler optimize it.

The same principles apply within SSDs.

The smallest writable location in NAND flash is a page; that doesn’t mean that it’s the largest size a controller can choose to write. Today I’d like to introduce the concept of a logical page, an abstraction of a physical page in NAND flash.

Confused? Let’s start with a (hopefully, I'm no artist) helpful diagram:

On one side of the fence we have how the software views storage: as a long list of logical block addresses. It’s a bit more complicated than that since a traditional hard drive is faster at certain LBAs than others but to keep things simple we’ll ignore that.

On the other side we have how NAND flash stores data, in groups of cells called pages. These days a 4KB page size is common.

In reality there’s no fence that separates the two, rather a lot of logic, several busses and eventually the SSD controller. The latter determines how the LBAs map to the NAND flash pages.

The most straightforward way for the controller to write to flash is by writing in pages. In that case the logical page size would equal the physical page size.

Unfortunately, there’s a huge downside to this approach: tracking overhead. If your logical page size is 4KB then an 80GB drive will have no less than twenty million logical pages to keep track of (20,971,520 to be exact). You need a fast controller to sort through and deal with that many pages, a lot of storage to keep tables in and larger caches/buffers.

The benefit of this approach however is very high 4KB write performance. If the majority of your writes are 4KB in size, this approach will yield the best performance.

If you don’t have the expertise, time or support structure to make a big honkin controller that can handle page level mapping, you go to a larger logical page size. One such example would involve making your logical page equal to an erase block (128 x 4KB pages). This significantly reduces the number of pages you need to track and optimize around; instead of 20.9 million entries, you now have approximately 163 thousand. All of your controller’s internal structures shrink in size and you don’t need as powerful of a microprocessor inside the controller.

The benefit of this approach is very high large file sequential write performance. If you’re streaming large chunks of data, having big logical pages will be optimal. You’ll find that most flash controllers that come from the digital camera space are optimized for this sort of access pattern where you’re writing 2MB - 12MB images all the time.

Unfortunately, the sequential write performance comes at the expense of poor small file write speed. Remember that writing to MLC NAND flash already takes 3x as long as reading, but writing small files when your controller needs large ones worsens the penalty. If you want to write an 8KB file, the controller will need to write 512KB (in this case) of data since that’s the smallest size it knows to write. Write amplification goes up considerably.

Remember the first OCZ Vertex drive based on the Indilinx Barefoot controller? Its logical page size was equal to a 512KB block. OCZ asked for a firmware that enabled page level mapping and Indilinx responded. The result was much improved 4KB write performance:

Iometer 4KB Random Writes, IOqueue=1, 8GB sector space Logical Block Size = 128 pages Logical Block Size = 1 Page
Pre-Release OCZ Vertex 0.08 MB/s 8.2 MB/s

A Quick Flash Refresher The Cleaning Lady and Write Amplification
Comments Locked

295 Comments

View All Comments

  • jengeek - Wednesday, September 2, 2009 - link

    As of 09-02-09 from Toshiba Direct:

    80GB = $243
    160GB = $473

    http://www.toshibadirect.com/td/b2c/adet.to?poid=4...">http://www.toshibadirect.com/td/b2c/adet.to?poid=4...

    http://www.toshibadirect.com/td/b2c/adet.to?poid=4...">http://www.toshibadirect.com/td/b2c/adet.to?poid=4...
  • gfody - Thursday, September 3, 2009 - link

    nice thank you, ordered mine from here
    screw Newegg! :D
  • jengeek - Wednesday, September 2, 2009 - link

    Both are G2, in stock and ship the next day

    Both are retail box including the installation kit

    Best price I've found
  • ARoyalF - Sunday, September 13, 2009 - link

    Thank you posting that!

    I was going to wait out that awful price hike over at the egg.

    You rock
  • ElderTech - Tuesday, September 1, 2009 - link

    It's difficult to imagine the amount of time and effort that went into this article, Anand. Just the clean installs of Win7 took a fair amount of extra effort, let alone the other detailed diagrams and testing involved. From an old technology advocate over many years of working to keep pace with Moore's Law in a variety of research environments, your site provides the most satisfying learning experience of all. A sincere thank you!

    PS: As for the availability of the G2, it pops in and out of stock at a variety of online retailers, including Newegg, of course, as well as MWave. Both had it available for a short while at $249, Newegg on Friday and MWave today, Monday. However, it's out of stock presently as of midnight, EST 9-1-09 at both, with MWave still at $249 but Newegg going from there to $279 over the weekend and now at an amazing $499! OUCH. Sounds like supply and demand gouging if the price holds when they are next available! There is also some stock available in the distributor channel from small Intel Partners, as I confirmed by calling around the Chicago area. You might give this a try tomorrow. Good luck!
  • blyndy - Monday, August 31, 2009 - link

    You really got performance anxiety because some high-profile people/sites liked your article and linked to it? It's hardly like it got printed in some prestigious science journal and the publishers are waiting on a follow-up.

    It was just the first time that SDD operation had been detailed in plain english from a reputable website.

    Enough of this 'anthology' nonsense, I don't care if it's 1 page or 20, just tell me how some of the new SSDs perform (eg OCZ, Western Digital). You've already detailed how they work so now I want to know which ones do/will support TRIM and some details on the controller. Nothing to get anxious about.
  • Anand Lal Shimpi - Monday, August 31, 2009 - link

    Indeed I did get performance anxiety after the last one, I even got it after the first X25-M. It's not so much the linkage, but the feedback from all of you guys. I received more positive feedback to the last SSD article than any one prior. More than anything I don't want to let you all down and I want to make sure I live up to everyone's expectations.

    As far as your interests go, all three manufacturers (Indilinx, Intel and Samsung) have confirmed support for TRIM. When? I'd say all three before December.

    Take care,
    Anand
  • cacca - Thursday, September 3, 2009 - link

    Dear Anand i really thank you for your SSD articles, the improvements in this area seem tangible.
    Can I ask you to test Fusion-IO & ioXtreme, i am really curious to see how this other approach performs.
    I know that isn't a perfect apple to apple comparison but at least we could compare the per $ performance.

    Best regards

    Ca
  • vol7ron - Monday, August 31, 2009 - link

    Good article.

    I have a follow-up question regarding your size suggestion.

    In more words you say, "get the size you need," but don't these drives perform that much better in a RAIDed system?

    The cost per GB isn't that much more if you're looking at getting a 160GB Intel drive, to get the 2x 80GB instead.

    SSDs are more reliable than HDs and you have the benefit of more RAM. 2x 32MB for an SSD in RAID0.


    Curious to hear your thoughts,
    vol7ron
  • StraightPipe - Tuesday, September 1, 2009 - link

    Since RAID cards aren't going to support TRIM commands for a while, I'd stick with a large, single SSD.

    Anybody ahve any experience running these cards in RAID? I'd love to put some of these in my server, but i'm terrified of lossing data through the complexities of RAID combined with SSD.

    I'd love to do a simple RAID1 setup, but it looks like i may be better of waiting too.

    In the mean time, these look like a mean machine for an OS disk.

Log in

Don't have an account? Sign up now