Multimedia Information Systems Shahram Ghandeharizadeh Computer Science Department University of Southern California.

Slides:



Advertisements
Similar presentations
Disk Storage SystemsCSCE430/830 Disk Storage Systems CSCE430/830 Computer Architecture Lecturer: Prof. Hong Jiang Courtesy of Yifeng Zhu (U. Maine) Fall,
Advertisements

I/O Management and Disk Scheduling
Faculty of Information Technology Department of Computer Science Computer Organization Chapter 7 External Memory Mohammad Sharaf.
Magnetic Disk Magnetic disks are the foundation of external memory on virtually all computer systems. A disk is a circular platter constructed of.
- Dr. Kalpakis CMSC Dr. Kalpakis 1 Outline In implementing DBMS we need to answer How should the system store and manage very large amounts of data?
CSCE430/830 Computer Architecture
Continuous Media 1 Differs significantly from textual and numeric data because of two fundamental characteristics: –Real-time storage and retrieval –High.
Faculty of Information Technology Department of Computer Science Computer Organization and Assembly Language Chapter 6 External Memory.
Allocating Memory.
The Memory Hierarchy fastest, perhaps 1Mb
Storage. The Memory Hierarchy fastest, but small under a microsecond, random access, perhaps 2Gb Typically magnetic disks, magneto­ optical (erasable),
CS4432: Database Systems II Data Storage - Lecture 2 (Sections 13.1 – 13.3) Elke A. Rundensteiner.
Input/Output Management and Disk Scheduling
Lecture 3: A Case for RAID (Part 1) Prof. Shahram Ghandeharizadeh Computer Science Department University of Southern California.
1 Storage Hierarchy Cache Main Memory Virtual Memory File System Tertiary Storage Programs DBMS Capacity & Cost Secondary Storage.
SECTIONS 13.1 – 13.3 Sanuja Dabade & Eilbroun Benjamin CS 257 – Dr. TY Lin SECONDARY STORAGE MANAGEMENT.
CS4432: Database Systems II Lecture 2 Timothy Sutherland.
CS 342 – Operating Systems Spring 2003 © Ibrahim Korpeoglu Bilkent University1 Input/Output – 5 Disks CS 342 – Operating Systems Ibrahim Korpeoglu Bilkent.
1 CS222: Principles of Database Management Fall 2010 Professor Chen Li Department of Computer Science University of California, Irvine Notes 01.
SECTIONS 13.1 – 13.3 Sanuja Dabade & Eilbroun Benjamin CS 257 – Dr. TY Lin SECONDARY STORAGE MANAGEMENT.
CPSC 231 Secondary storage (D.H.)1 Learning Objectives Understanding disk organization. Sectors, clusters and extents. Fragmentation. Disk access time.
Introduction to Database Systems 1 The Storage Hierarchy and Magnetic Disks Storage Technology: Topic 1.
Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition, Chapter 12: Mass-Storage Systems.
MM File Management Karrie Karahlaios and Brian P. Bailey Spring 2007.
CS4432: Database Systems II Data Storage (Better Block Organization) 1.
CENG334 Introduction to Operating Systems Erol Sahin Dept of Computer Eng. Middle East Technical University Ankara, TURKEY URL:
CS 352 : Computer Organization and Design University of Wisconsin-Eau Claire Dan Ernst Storage Systems.
Lecture 11: DMBS Internals
B. Prabhakaran1 Multimedia Storage & Retrieval Large sizes as well as real-time requirements of multimedia objects influence their storage and retrieval.
I/O – Chapter 8 Introduction Disk Storage and Dependability – 8.2 Buses and other connectors – 8.4 I/O performance measures – 8.6.
Topic: Disks – file system devices. Rotational Media Sector Track Cylinder Head Platter Arm Access time = seek time + rotational delay + transfer time.
Disk Structure Disk drives are addressed as large one- dimensional arrays of logical blocks, where the logical block is the smallest unit of transfer.
Chapter 12: Mass-Storage Systems Silberschatz, Galvin and Gagne ©2005 Operating System Concepts – 7 th Edition, Jan 1, 2005 Chapter 12: Mass-Storage.
Quality of Service Karrie Karahalios Spring 2007.
I/O Management and Disk Structure Introduction to Operating Systems: Module 14.
Disks Chapter 5 Thursday, April 5, Today’s Schedule Input/Output – Disks (Chapter 5.4)  Magnetic vs. Optical Disks  RAID levels and functions.
Annoucements Read the papers for next week posted on Read the papers for next week posted on
Storage and Indexes Introduction to Databases Computer Science 557 Instructor: Joe Bockhorst University of Wisconsin - Milwaukee.
Chapter 8 CPU and Memory: Design, Implementation, and Enhancement The Architecture of Computer Hardware and Systems Software: An Information Technology.
Practice 8 Chapter Ten. 1. Is disk scheduling, other than FCFS scheduling, useful in a single-user environment? Explain your answer. Answer: In a single-user.
Chapter 8 External Storage. Primary vs. Secondary Storage Primary storage: Main memory (RAM) Secondary Storage: Peripheral devices  Disk drives  Tape.
Lecture 3 Page 1 CS 111 Online Disk Drives An especially important and complex form of I/O device Still the primary method of providing stable storage.
DMBS Internals I. What Should a DBMS Do? Store large amounts of data Process queries efficiently Allow multiple users to access the database concurrently.
Lecture 40: Review Session #2 Reminders –Final exam, Thursday 3:10pm Sloan 150 –Course evaluation (Blue Course Evaluation) Access through.
Disk Basics CS Introduction to Operating Systems.
Storing and Serving Multimedia. What is a Media Server? A scalable storage manager Allocates multimedia data optimally among disk resources Performs memory.
I/O Devices. Characteristics of I/O Devices  Block Devices  Information are stored and accessed in fixed-size blocks  Addressable, can have sequential.
Operating Systems (CS 340 D) Princess Nora University Faculty of Computer & Information Systems Computer science Department.
Operating Systems (CS 340 D) Princess Nora University Faculty of Computer & Information Systems Computer science Department.
Section 13.2 – Secondary storage management (Former Student’s Note)
DMBS Internals I. What Should a DBMS Do? Store large amounts of data Process queries efficiently Allow multiple users to access the database concurrently.
Device Management Mark Stanovich Operating Systems COP 4610.
Disk Average Seek Time. Multi-platter Disk platter Disk read/write arm read/write head.
CPSC 231 Secondary storage (D.H.)1 Learning Objectives Understanding disk organization. Sectors, clusters and extents. Fragmentation. Disk access time.
COSC 6340: Disks 1 Disks and Files DBMS stores information on (“hard”) disks. This has major implications for DBMS design! » READ: transfer data from disk.
Part IV I/O System Chapter 12: Mass Storage Structure.
1 Components of the Virtual Memory System  Arrows indicate what happens on a lw virtual address data physical address TLB page table memory cache disk.
Section 13.2 – Secondary storage management (Former Student’s Note)
Disk Scheduling Algorithms
DISK SCHEDULING FCFS SSTF SCAN/ELEVATOR C-SCAN C-LOOK.
Lecture 45 Syed Mansoor Sarwar
Lecture 11: DMBS Internals
Sanuja Dabade & Eilbroun Benjamin CS 257 – Dr. TY Lin
Operating Systems (CS 340 D)
Overview Continuation from Monday (File system implementation)
Persistence: hard disk drive
Mass-Storage Systems.
Chapter 5 External Memory
Chapter 11 I/O Management and Disk Scheduling
Disk Scheduling The operating system is responsible for using hardware efficiently — for the disk drives, this means having a fast access time and disk.
Presentation transcript:

Multimedia Information Systems Shahram Ghandeharizadeh Computer Science Department University of Southern California

Reading n First 11 (until Section 3.2) pages of: S. Ghandeharizadeh and R. Muntz, “Design and Implementation of Scalable Continuous Media Servers,” Parallel Computing, Elsevier 1998.

MULTIMEDIA n Multimedia now: n Multimedia in a few years from now: n Remaining:

Continuous Media: Audio & Video n Display of a clip as a function of time. Constant Bit RateVariable Bit Rate Time Bytes

Continuous Media: Audio & Video n A clip has a fixed display time. Constant Bit RateVariable Bit Rate Time Bytes Clip display time

Continuous Media: Audio & Video n A clip has a fixed size. Constant Bit RateVariable Bit Rate Time Bytes Clip size

Continuous Media: Audio & Video n Average bandwidth for continuous display is clip size divided by the clip display time. Constant Bit RateVariable Bit Rate Time Bytes Display bandwidth requirements BW = Line slope

Time and space n One may manipulate the bandwidth required to display a clip by prefetching a portion of the clip. Constant Bit Rate Media Time Bytes Startup latency Prefetch portion

Continuous display from magnetic disk n Target architecture MemoryCPU Display System Bus

Continuous display n Once display is initiated, it should not starve for data. Otherwise, display will suffer from frequent disruptions and delays, termed hiccups. MemoryCPU Display System Bus

Continuous display: using memory n Given the low latency between memory and display, stage the entire clip from disk onto memory and then initiate its display. MemoryCPU Display System Bus

Continuous display: using memory n Limitations: – Forces the user to wait un-necessarily. – Requires a large memory module in the order of Gigabytes for 2 hour movies. MemoryCPU Display System Bus

Continuous display: pipelining n Partition a clip X into n fixed size blocks: X 1, X 2, X 3, …, X n n Stage X i in memory and initiate its display. n Stage X i+1 in memory prior to completion of the display of X i Display X1Display X2Display Disk X1X2 Time Period

Pipelining: multiple displays n With multiple displays, disk is multiplexed between multiple requests, resulting in disk seeks. Display X i Display X i+1 Display Disk XiXi X i+1 Time Period WjWj Seek + Rotational delay ZkZk W j+1 Z k+1

How to manage disk seeks? n Live with it: – Assume the worst seek time in order to guarantee hiccup-free display – Assume average seek time if hiccups are acceptable. n Use the elevator algorithm by delaying display of a block to the end of a time period, termed Group Sweeping Scheme (GSS): Display X1Display Disk X1X1 W j+1 Time Period WjWj ZkZk Z k+1 X2X2 Z k+2

Impact of block size n Disk service time with transfer-rate tfr and block size B is: – T disk = T seek + T RotLatency + (B / tfr) n Number of simultaneous displays supported by a single disk is: N = Tp/Tdisk n Simple pipelining requires (N+1)B memory, GSS requires 2NB. n The observed transfer rate of a disk drive is a function of B and its physical characteristics: tfr obs = tfr ( B / [B + (T seek + T latency ) tfr] ) n Percentage of wasted disk bandwidth: 100 * (tfr – tfr obs ) / tfr

Impact of block size n MPEG-1 clips with 1.5 Mbps bandwidth requirements n Target disk characteristics: Seek: max = 17 msec, min = 2 msec Rotational latency: Max = 8.3 msec, min = 4.17 msec Disk tfr = 68.6 Mbps n Throughput and startup latency as a function of block size: Block sizeNMemory RequiredLatency Sec (2 T p )Wasted disk BW (%) 8 KB580 KB KB10320 KB KB161 MB KB243 MB KB328 MB KB MB KB4141 MB MB4396 MB10.666

Modern disks are multi-zoned n Each zone provides a different storage capacity (number of tracks and sectors per track) and transfer rate. n Outermost zone is typically twice faster than the innermost zone.

Seagate ST31200W zones

Seagate ST31200W n Consists of 2697 cylinders. One may model its seek characteristics as follows:

Seagate ST31200W

IBM’s Logical Track n Let Z min denote the zone with fewest track, T min n A disk with Z zones is collapsed into a logical disk consisting of one zone with T min tracks. Size of each track is Z * T avg n The size of a block must be a multiple of the logical track size n Disadvantage: Z+1 seeks to retrieve a logical track Logical Track 1 Logical Track 2 Logical Track 3

HP’s Track Pairing n Let Z min denote the zone with fewest track, T min n Pair outermost track with the innermost one and continue inward. n A disk with Z zones is collapsed into a logical disk consisting of one zone with (Z*T min )/2 tracks. n The size of a block must be a multiple of a track pair n Disadvantage: 2 seeks to retrieve a logical track Logical Track 1 Logical Track 2 Logical Track 3 Logical Track

USC’s region-based approach n Partition the Z zones into R regions. A region may consist of 1 or more consecutive zones. The slowest participating zone dictates transfer rate of its assigned region. n Assign blocks of a clip to regions in a round-robin manner. n Display of clips requires visiting regions one at a time, multiplexing their bandwidth between N active requests. Both fix sized blocks and variable length blocks are supported. Region 1 Region 2

Multi-zone disk drives n With all 3 techniques, one may selectively drop zones: sacrifice storage for bandwidth! n Example: USC’s region-based approach Region 1 Region 2

FIXB n Partition a clip into fix sized blocks and assign them to the regions in a round-robin manner. n During a time period, retrieve blocks from one region at a time. n Display starts when sufficient data is in main memory.

FIXB n Amount of data produced during (1 maximum seek + T Scan ) is identical to the amount of data displayed during T Scan.

FIXB

VARB n Variable size blocks dictated by the transfer rate of each zone. n Amount of data produced during one T MUX is identical to the amount of data displayed during T MUX. n Limitation: complex to implement due to variable block sizes.

Comparison n FIXB and VARB waste space due to: 1. Round-robin assignment of blocks to zones 2. Different zones offer different storage capacities.

Comparison