Presentation is loading. Please wait.

Presentation is loading. Please wait.

VectorWise The world’s fastest database GIUA, 13 September 2011.

Similar presentations


Presentation on theme: "VectorWise The world’s fastest database GIUA, 13 September 2011."— Presentation transcript:

1 VectorWise The world’s fastest database GIUA, 13 September 2011

2 © 2011 Ingres Corporation

3 DBT-3 Database Schema © 2011 Ingres Corporation

4 DBT-3 Data © 2011 Ingres Corporation

5 What is VectorWise?  Started as an academic project –Centrum Wiskunde & Informatica (CWI) Python MonetDB X100 VectorWise  Adopted as an Ingres community project  Joint venture company set up between CWI and Ingres Corp.  Now wholly owned by Ingres Corp. © 2011 Ingres Corporation

6 What is VectorWise for?  Data warehousing  Data marts  Data mining  Online Analytical Processing (OLAP)  Business Intelligence © 2011 Ingres Corporation

7 VectorWise Technology On Chip Computing Time / Cycles to Process Data Processed DISK RAM CHIP 10GB 2-3GB 40-400MB 2-20 150-250 Millions Vector Processing Breakthrough technology © 2011 Ingres Corporation

8 On Chip Computing  Processing in Chip Cache  CPU cache access is more efficient than RAM cache access Time / Cycles to Process Data Processed DISK RAM CHIP 10GB2-3GB40-100MB 2-20 150-250 Millions © 2011 Ingres Corporation

9 Vector Processing verses = 1 x 1 = 1 2 x 2 = 4 3 x 3 = 9 4 x 4 = 16 5 x 5 = 25 6 x 6 = 36 7 x 7 = 49 8 x 8 = 64... n x n = n 2 SISD Single Instruction Single Data processed SIMD Single Instruction Multiple Data processed © 2011 Ingres Corporation

10 VectorWise Technology Automatic Compression Updateable Column Store Automatic Storage Indexes Minimize IO Innovations on industry proven techniques © 2011 Ingres Corporation

11 Updateable Column Store  Only access relevant data  Efficient incremental update enabled –Traditionally a weakness of column stores Cust_NumCust_surnameCust_first_nameCust_DOBCust_SexCust_Add_1Cust_Addr_2Cust_CityCust_State 46328927956JonesSteven17-JAN-1971M333 StKilda RdMelbourneVic 98679975745SmithLeonard04-APR-1964M147 Trafalgar RoadBirminghamEngland 52634346735RogersCindy11-MAR-1980FBelmont Rail Service 421 Station St BelmontCA 346737347347AndrewsJenny14-SEP-1977F117 West 42 nd StNew YorkNY 88673477347CooperSheldon30-JUN-1980MIngres CorporationLevel 2, 426 Argello StRedwood CityCA 34673447568KollwitzRolf22-DEC-1975MIBM Headquarters123 Mount View CrsAtlantic CityPN 99554443044WongPenny13-NOV-1981FMing On Tower 1177 Moa Tzu Tung RdBeijingChina © 2011 Ingres Corporation

12 Automatic Compression  Vectorized compression –Compressed on disk –Decompression for data processing in CPU cache –Compressed in RAM  Column based compression with multiple algorithms –Automatically determined by VectorWise © 2011 Ingres Corporation

13 Compression Methods  Run Length Encoding –Efficient if many duplicate adjacent tuple values are present –Such as in ordered columns with few unique values  Patched Frame Of Reference –Encodes values as a small difference from a page-wide base value –PFOR is effective on any data distribution with some value distribution locality  Delta encoding on top of PFOR –Integers are made smaller by considering the differences between subsequent values –Highly effective on ordered data  PDICT dictionary encoding –Efficient in case the value distribution is dominated by a limited amount of very frequent values –Is currently the only one that applies to character data types © 2011 Ingres Corporation

14 Automatic Storage Indexes  Stores min/max value per data block  Automatically created  Automatically maintained  Enables efficient identification of candidate data blocks © 2011 Ingres Corporation

15 authpass IVW LOG User Interface (SQL, ABF, OpenROAD, JAVA, etc.) DAS Server (iigcd) Communications Server (iigcc) Archiver (iiacp) Recovery Server (iircp) Journals Ingres Transaction Log File VectorWise Instance Architecture Name Server (iigcn) User Interface (SQL, ABF, OpenROAD, etc.) DBMS Server (iidbms) LocksLog Buffers iix100 Server VectorWise Data Store IVW Memory IVW LOCK Databases © 2011 Ingres Corporation

16 Operating System  Currently available on 64-bit Linux and Windows  Runs on –RedHat –Fedora –CentOS –SuSE11 –Ubuntu –Works on other Linux flavours –Windows 2008 –Windows 7 © 2011 Ingres Corporation

17 Hardware Requirements  Fast multi-core CPUs  Memory –2 Gbytes for OS + IVW requirements + other apps –Minimum 8 Gbytes  Disk –Lots © 2011 Ingres Corporation

18 And now live © 2011 Ingres Corporation


Download ppt "VectorWise The world’s fastest database GIUA, 13 September 2011."

Similar presentations


Ads by Google