Hystor : Making the Best Use of Solid State Drivers in High Performance Storage Systems Presenter : Dong Chang.

Slides:



Advertisements
Similar presentations
Paper by: Yu Li, Jianliang Xu, Byron Choi, and Haibo Hu Department of Computer Science Hong Kong Baptist University Slides and Presentation By: Justin.
Advertisements

Flash storage memory and Design Trade offs for SSD performance
Jaewoong Sim Alaa R. Alameldeen Zeshan Chishti Chris Wilkerson Hyesoon Kim MICRO-47 | December 2014.
Thread Criticality Predictors for Dynamic Performance, Power, and Resource Management in Chip Multiprocessors Abhishek Bhattacharjee Margaret Martonosi.
Daniel Schall, Volker Höfner, Prof. Dr. Theo Härder TU Kaiserslautern.
Query Processing and Optimizing on SSDs Flash Group Qingling Cao
Myoungsoo Jung (UT Dallas) Mahmut Kandemir (PSU)
Trading Flash Translation Layer For Performance and Lifetime
File Systems.
CS 5204 – Operating Systems 1 Scheduler Activations.
FlashVM: Virtual Memory Management on Flash Mohit Saxena and Michael M. Swift Introduction Flash storage is the largest change to memory and storage systems.
Shimin Chen Big Data Reading Group.  Energy efficiency of: ◦ Single-machine instance of DBMS ◦ Standard server-grade hardware components ◦ A wide spectrum.
The Memory Hierarchy (Lectures #24) ECE 445 – Computer Organization The slides included herein were taken from the materials accompanying Computer Organization.
CMPT 300: Final Review Chapters 8 – Memory Management: Ch. 8, 9 Address spaces Logical (virtual): generated by the CPU Physical: seen by the memory.
An Adaptable Benchmark for MPFS Performance Testing A Master Thesis Presentation Yubing Wang Advisor: Prof. Mark Claypool.
File System Implementation CSCI 444/544 Operating Systems Fall 2008.
Accurate and Efficient Replaying of File System Traces Nikolai Joukov, TimothyWong, and Erez Zadok Stony Brook University (FAST 2005) USENIX Conference.
Physical Database Monitoring and Tuning the Operational System.
CMPT 300: Final Review Chapters 8 – Memory Management: Ch. 8, 9 Address spaces Logical (virtual): generated by the CPU Physical: seen by the memory.
U NIVERSITY OF M ASSACHUSETTS, A MHERST Department of Computer Science Emery Berger University of Massachusetts, Amherst Operating Systems CMPSCI 377 Lecture.
Solid State Drive Feb 15. NAND Flash Memory Main storage component of Solid State Drive (SSD) USB Drive, cell phone, touch pad…
Synergy.cs.vt.edu Power and Performance Characterization of Computational Kernels on the GPU Yang Jiao, Heshan Lin, Pavan Balaji (ANL), Wu-chun Feng.
SQL Server 2008 & Solid State Drives Jon Reade SQL Server Consultant SQL Server 2008 MCITP, MCTS Co-founder SQLServerClub.com, SSC
Just a really fast drive Jakub Topič, I3.B
Slide 1 Windows PC Accelerators Reporter :吳柏良. Slide 2 Outline l Introduction l Windows SuperFetch l Windows ReadyBoost l Windows ReadyDrive l Conclusion.
Understanding Intrinsic Characteristics and System Implications of Flash Memory based Solid State Drives Feng Chen, David A. Koufaty, and Xiaodong Zhang.
RAID: High-Performance, Reliable Secondary Storage Mei Qing & Chaoxia Liao Nov. 20, 2003.
Lecture 11: DMBS Internals
Flashing Up the Storage Layer I. Koltsidas, S. D. Viglas (U of Edinburgh), VLDB 2008 Shimin Chen Big Data Reading Group.
CuMAPz: A Tool to Analyze Memory Access Patterns in CUDA
Mayuresh Varerkar ECEN 5613 Current Topics Presentation March 30, 2011.
Data Storage Systems: A Survey Abdullah Aldhamin July 29, 2013 CMPT 880: Large-Scale Multimedia Systems and Cloud Computing Course Project.
Embedded System Lab. 김해천 Linearly Compressed Pages: A Low- Complexity, Low-Latency Main Memory Compression Framework Gennady Pekhimenko†
Our work on virtualization Chen Haogang, Wang Xiaolin {hchen, Institute of Network and Information Systems School of Electrical Engineering.
The Design and Implementation of Log-Structure File System M. Rosenblum and J. Ousterhout.
3-May-2006cse cache © DW Johnson and University of Washington1 Cache Memory CSE 410, Spring 2006 Computer Systems
+ CS 325: CS Hardware and Software Organization and Architecture Memory Organization.
1 Virtual Memory Main memory can act as a cache for the secondary storage (disk) Advantages: –illusion of having more physical memory –program relocation.
Cheap and Large CAMs for High Performance Data-Intensive Networked Systems Ashok Anand, Chitra Muthukrishnan, Steven Kappes, and Aditya Akella University.
PROBLEM STATEMENT A solid-state drive (SSD) is a non-volatile storage device that uses flash memory rather than a magnetic disk to store data. SSDs provide.
Latency Reduction Techniques for Remote Memory Access in ANEMONE Mark Lewandowski Department of Computer Science Florida State University.
Improving Disk Throughput in Data-Intensive Servers Enrique V. Carrera and Ricardo Bianchini Department of Computer Science Rutgers University.
Introduction: Memory Management 2 Ideally programmers want memory that is large fast non volatile Memory hierarchy small amount of fast, expensive memory.
Operating Systems: Wrap-Up Questions answered in this lecture: What is an Operating System? Why are operating systems so interesting? What techniques can.
Transforming Policies into Mechanisms with Infokernel Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau, Nathan C. Burnett, Timothy E. Denehy, Thomas J.
Memory Resource Management in VMware ESX Server By Carl A. Waldspurger Presented by Clyde Byrd III (some slides adapted from C. Waldspurger) EECS 582 –
 The emerged flash-memory based solid state drives (SSDs) have rapidly replaced the traditional hard disk drives (HDDs) in many applications.  Characteristics.
Rethinking RAID for SSD based HPC Systems Yugendra R. Guvvala, Yong Chen, and Yu Zhuang Department of Computer Science, Texas Tech University, Lubbock,
DATABASE OPERATORS AND SOLID STATE DRIVES Geetali Tyagi ( ) Mahima Malik ( ) Shrey Gupta ( ) Vedanshi Kataria ( )
1 Paolo Bianco Storage Architect Sun Microsystems An overview on Hybrid Storage Technologies.
CDA 3101 Spring 2016 Introduction to Computer Organization Physical Memory, Virtual Memory and Cache 22, 29 March 2016.
Internal Parallelism of Flash Memory-Based Solid-State Drives
Lesson Objectives Aims Key Words Paging, Segmentation, Virtual Memory
CS 704 Advanced Computer Architecture
Seth Pugsley, Jeffrey Jestes,
Memory COMPUTER ARCHITECTURE
Lecture: Large Caches, Virtual Memory
Database Management Systems (CS 564)
Hardware September 19, 2017.
Lecture 11: DMBS Internals
Repairing Write Performance on Flash Devices
RAID RAID Mukesh N Tekwani
Chapter 11: File System Implementation
Lecture 14 Virtual Memory and the Alpha Memory Hierarchy
Chap. 12 Memory Organization
Database Systems Instructor Name: Lecture-3.
Outline Announcements Lab2 Distributed File Systems 1/17/2019 COP5611.
Outline Review of Quiz #1 Distributed File Systems 4/20/2019 COP5611.
RAID RAID Mukesh N Tekwani April 23, 2019
Dong Hyun Kang, Changwoo Min, Young Ik Eom
Presentation transcript:

Hystor : Making the Best Use of Solid State Drivers in High Performance Storage Systems Presenter : Dong Chang

Introduction Contributions SSD Performance Advantages System Experiments Conclusions Outline

Introduction Introduction Contributions SSD Performance Advantages System Experiments Conclusions Outline

Introduction Data-intensive computing are in high demand for high-performance storage systems. HDD disadvantages: low random access performance and high power consumption. SSD : semiconductor chips without moving parts, providing higher performance. SSD should not be a replacement but an enhancement of HDD.

Introduction DRAM300K$120K + Disk250$30 + Random reads/sec Cost (128 GB) Flash-SSD10K*$225 + Random writes/sec K 5K* Too slow Too expensive * Derived from latencies on Intel M-18 SSD in experiments 2.5 ops/sec/$ Slow writes + Price statistics from

Introduction  Finding the fittest position of SSDs in storage system? Critical Issues:  Effectively identifying the most performance-critical blocks and fully exploiting the unique performance potential of SSDs.  Efficiently maintaining data access history with low overhead for accurately characterizing access patterns.  Avoiding major kernel changes in existing systems while effectively implementing the hybrid storage management policies

Introduction Contributions SSD Performance Advantages System Experiments Conclusions Outline

Contributions Identify an effective metric to represent the performance-critical blocks. Design an efficient mechanism to profile and maintain detailed data access history for a long-term optimization. Design and implementation of a high performance hybrid storage system,Hystor.

Introduction Contributions SSD Performance Advantages System Experiments Conclusions Outline

SSD Performance Advantages  Performance benefits are dependent on workload access patterns.  High write performance on the SSD (up to 194MB/sec).  Write performance on the SSD is largely independent of access patterns, and random writes can achieve almost identical performance as sequential writes.

SSD Performance Advantages The consideration in the design of Hystor: workload access patterns 1. Recognize workload access patterns to identify the most high-cost data blocks, especially those blocks being randomly accessed by small requests, which cause the worst performance for HDDs. write-back 2. Leverage the SSD as a write-back buffer to handle writes, which often raise high latencies in HDDs. we do not have to treat random writes specifically, since random writes on SSD can perform as fast as sequential writes.

Introduction Contributions SSD Performance Advantages System Experiments Conclusions Outline

System High-cost data block How to identify it? indicator metrics: frequency/size

System Manage data access history Maintain history information---block table

System Manage data access history inverse bitmap Represent the metric: inverse bitmap (to encode the request size and frequency ) A block is accessed by a request of N sectors, an inverse bitmap, b, is calculated using the following equation:

System Main Architecture

System Hystor Design : Logical Block Mapping SSD Space Management Managing the Remap Area Identifying High-Cost Data Blocks Reorganizing Data Layout across Devices User-level Monitor Identifying Metadata Blocks Managing the Write-back Area

Introduction Contributions SSD Performance Advantages System Experiments Conclusions Outline

Experiments Intel ® D975BX system 2.66GHz Intel ® Core™ 2 Quad CPU and 4GB main memory

Experiments Performance of Hystor

Experiments Performance of Hystor

Introduction Contributions SSD Performance Advantages System Experiments Conclusions Outline

Conclusions Identify the data that are best suitable to be held in SSD by using a simple yet effective metric SSDs should play a major role in the storage hierarchy retaining performance- and semantically-critical data, and it can also be as a write-back buffer