Wei-Pang Yang, Information Management, NDHU 0-1 DATABASE SYSTEMS OVERVIEW 國立東華大學 資訊管理系 楊維邦 教授

Wei-Pang Yang, Information Management, NDHU 0-2 Database System: Introduction  Database Management System (DBMS)  Contains a large bodies of information  Collection of interrelated data (database)  Set of programs to access the data  Goal of a DBMS:  provides a way to store and retrieve database information convenient and efficient

Wei-Pang Yang, Information Management, NDHU 0-3 Database System: Introduction (cont.)  Functions of DBMS: Management of Data (MOD)  Defining structure for storage data  Proving mechanisms for manipulation of data  Ensure safety of data (system crashes, unauthorized access, misused, …)  Concurrent control in multi-user environment  Computer Scientists:  Developed a lot of concepts and techniques for MOD  Concepts and techniques form the focus of this course

Wei-Pang Yang, Information Management, NDHU 0-4  Introduction  Why Database Systems?  An Architecture for a Database System  Data Models  Components of a Database System  How to establish a Database System?  Discussion and Remarks  Extending Database Technology  Data Structure and Database 課程流程圖  Research on Database Contents

Wei-Pang Yang, Information Management, NDHU 0-5  Conventional Data Processing techniques: Enterprise: Application System A Application Program A File System A Customer Application System B Application Program B File System B Invoice Application System N Application Program N File System N Inventory … 0.1 Why Database Systems?

Wei-Pang Yang, Information Management, NDHU 0-6 CustomerInvoice Inventory Parts Customer No. Customer Name Customer Addr. Social Security ID Customer No. Customer Name Part No. Quantities Unit Price Part No. Part Description Unit Price Supplier Quantities Remain Quantities Ordered Part No. Part Description Supplier Quantities Ordered Customer Name Unit Price 0.1 Why Database Systems?  File System

Wei-Pang Yang, Information Management, NDHU Why Database Systems? File System : Advantages and Disadvantages  Advantages: File Systems are simple in design  Disadvantages: Data Redundancy: a waste of memory high update cost data inconsistency Data Incompleteness Data Insecure Application Program Unstable file system (application program) data changed data structure changed program changed

Wei-Pang Yang, Information Management, NDHU 0-8  Objectives of Database Systems: eliminate unnecessary data redundancy maintain data integrity control security achieve data independence add program stability 0.1 Why Database Systems? Solution: Database Systems!!

Wei-Pang Yang, Information Management, NDHU 0-9 Language Processor Optimizer Operation Processor Access Method File Manager Database Query DBMS SQL: Select S#, P# from S, P where… Architecture for a Database System View 1: DBMS Components

Wei-Pang Yang, Information Management, NDHU 0-10 Host Language + DSL Host Language + DSL Host Language + DSL Host Language + DSL Host Language + DSL User A1User A2User B1User B2User B3 External # & External View B External/conceptual mapping A Conceptual View External/conceptual mapping B Conceptual/internal mapping Stored database (Internal View) Database management system Dictionary (DBMS) e.g. system catalog < DBA Storage structure definition (Internal schema) Conceptual schema External schema A External schema B (Build and maintain schemas and mappings) & DSL (Data Sub. Language) C, C++ e.g. SQL Architecture for a Database System View 2: Three Tiers

Wei-Pang Yang, Information Management, NDHU 0-11 Scan figure 0.2 Architecture for a Database System : View 3: User’s View vs. Internal

Wei-Pang Yang, Information Management, NDHU 0-12 Scan figure 0.2 Architecture for a Database System : View 4: DBA vs. Programmers

Wei-Pang Yang, Information Management, NDHU 0-13  Hierarchical Data Model  Network Data Model  Relational Data Model  Object-Oriented Data Model  … 0.3 Data Models :

Wei-Pang Yang, Information Management, NDHU 0-14 Hierarchical Data Model Course# Title Course Prereq.#Off.#DateLocation Emp.#NameGradeEmp.#Name Offering Teacher course# name prereq off. 1 off. 2 prereq.1 prereq.2 92/9/6 course# name prereq.1 prereq.2 off.1 92/9/6 EE108 T003 Yang “ Data Pile ” Student PreReq

Wei-Pang Yang, Information Management, NDHU 0-15 Network Data Model S P S-SP P-SP QTY (Links) S# SNAME STATUS CITY SP

Wei-Pang Yang, Information Management, NDHU 0-16 S1 P1 300 …… S2 P1 300 S2 P SP P S S1 Smith 20 London S2 S3S4S5 P1 P2P3P4P5P The Network Model: Sample Values

Wei-Pang Yang, Information Management, NDHU 0-17  System R  DB2  INGRES  Oracle  Informix  ACCESS  … SP :Shipment S# P# QTY S1 P1 300 S1 P2 200 S1 P S2 P1 400 S2 P2 200 S1 Smith 20 London S2 Jones 10 Paris S3 : : : S4 : : : S: Supplier S# NAME Status City P: Parts P# P-Name Color Weight ………… P1 Nut Red 12 …… P2 Screw Blue 17. P3 : : : : : : : : : Relational Data Model: [Codd70]

Wei-Pang Yang, Information Management, NDHU 0-18 Person Object-Oriented Data Model Employee face-image Vehicle Company dept. salary name location model hair-color name owns photo manu. car-video video aggregation inheritance

Wei-Pang Yang, Information Management, NDHU 0-19  DDL (Data Definition Language)  DML (Data Manipulation Language)  Data Dictionary  Utility Routines 0.4 Components of a Database System

Wei-Pang Yang, Information Management, NDHU 0-20 CREATE TABLE S (S# CHAR(5) NOT NULL, SNAME CHAR(20) NOT NULL, STATUS SMALLINT NOT NULL, CITY CHAR(15) NOT NULL, PRIMARY KEY (S#)); ALTER TABLE S ADD DISCOUNT SMALLINT; DROP TABLE S CREATE INDEX XSC ON S (CITY); CREATE UNIQUE INDEX X ON S (S#); DROP INDEX XSC; 0.4 Components of a Database System: DDL (Data Definition Language) S: Supplier S# NAME Status City

Wei-Pang Yang, Information Management, NDHU 0-21 SELECT S#, STATUS FROM S WHERE CITY=‘PARIS’ UPDATE S SET STATUS= 2*STATUS WHERE CITY=‘LONDON’; DELETE FROM S WHERE S#= ‘S5’ INSERT INTO S (S#, SNAME, STATUS, CITY) VALUES(‘S6’,’TSENG’,100,’HSINCHU’) 0.4 Components of a Database System : DML (Data Manipulation Language) S: Supplier S# NAME Status City

Wei-Pang Yang, Information Management, NDHU Components of a Database System : Data Dictionary Application Program 9 Working Area System Buffer Secondary Memory Database DBMS Data Dictionary OS Request return

Wei-Pang Yang, Information Management, NDHU 0-23 Loading Routines Reorganization Routines Journalizing routines (log) Database Dump Routines Recovery Routines Statistical Analysis Routines … 0.4 Components of a Database System : Utility Routines:

Wei-Pang Yang, Information Management, NDHU 0-24  STEP 1: Database Design Logical database vs. physical database Collect data of applications Analyze data to eliminate redundancy (using normalization theory and E-R Model…) Describe data in the specific Data Model the DBMS use. Describe each schema in DDL  STEP 2: Implementation schema data  SETP3:Evaluation and Correction (by DBA) tuning statistical analysis 0.5 How to Establish a Database System?

Wei-Pang Yang, Information Management, NDHU 0-25  Advantages of database systems redundancy can be reduced Inconsistency can be avoid Data can be shared Standards can be enforced Security restrictions can be applied Integrity can be maintained Provision of data independence  Disadvantages of database systems Database design and control is a complicated matter. 0.6 Discussion and Remarks

Wei-Pang Yang, Information Management, NDHU 0-26 Expert Database Systems Knowledge-base Management Systems AI + DB Image Database Systems Intelligent Pictorial Databases Image + DB Object-Oriented Database Systems OO Programming + DB Multimedia Database Text + Voice + Image + …..+ DB Multidatabases Integrate heterogeneous /homogeneous database systems 0.7 Extending Database Technology

Wei-Pang Yang, Information Management, NDHU 0-27 Real-time Database Systems Real-time Tech. + DB Video Database Systems MPEG + DB Digital Library Library + DB Bioinformatic Database Systems Biological + DB … Extending Database Technology

Wei-Pang Yang, Information Management, NDHU DS and Database 課程流程圖 二下 : 資料庫管理 研上 : 高等資料庫管理 三四上 : 資料庫進階 一上 : 計算機概論 研上 : 高等資料庫管理 研下 : 影像資料庫 二上 : 資料結構 大一大一 大三四 大二大二 研究所 基本, 入門, 觀念 原理, 研究 研下 : 多媒體資料庫研下 : 知識庫管理 一下 : 程式設計 II 一上 : 程式設計 I Sorting, Hashing, 檔案結 構, web, 實例應用

Wei-Pang Yang, Information Management, NDHU 0-29 Chapter 1: Introduction Chapter 2: Entity-Relationship Model Chapter 3: Relational Model Chapter 4: SQL Chapter 5: Other Relational Languages Chapter 6: Integrity Constraints Chapter 7: Relational Database Design 資料庫管理 ( 大二下 )  References: 1. Silberschatz etc, Database System Concepts, 5 th edition, McGraw Hill, 2006

Wei-Pang Yang, Information Management, NDHU 0-30 Unit 1: Sorting (DS. Chapter 7) Unit 2: Hashing (DS. Chapter 8) Unit 3: Heap Structure (DS. Chapter 9) Unit 4: Searching Structure (DS. Chapter 10) Unit 5: XML (DBMS Chapter 10) Unit 6: Storage and File Structure (DBMS Chapter 11) Unit 7: Indexing and Hashing (DBMS Chapter 12) 資料庫進階 ( 大 三四上 )  References: 1. A. Silberschatz, etc, Database System Concepts, 5 th edition, McGraw Hill, E. Horowitz, etc. Fundamentals of Data Structures, …

Wei-Pang Yang, Information Management, NDHU 0-31 PART 0 Basic Concepts Chapter 0: Overview Chapter 1: Introduction PART 1 RELATIONAL DATABASES Chapter 2: Relational Model Chapter 3: SQL Chapter 4: Advanced SQL PART 2 DATABASE DESIGN Chapter 6: Database Design and the E-R Model Chapter 7: Relational Database Design Chapter 8: Application Design and Development PART 4 DATA STORAGE AND QUERYING Chapter 11: Storage and File Structure Chapter 12: Indexing and Hashing 資料庫管理 ( 大二下 ) 今 年今 年  Text Book: A. Silberschatz etc, “ Database System Concepts, ” 5 th edition, McGraw Hill, 2006

Wei-Pang Yang, Information Management, NDHU 0-32 Unit 1 Introduction to DBMS Unit 2 DB2 and SQL Unit 3 The Relational Model Unit 4 The Hierarchical Model Unit 5 The Network Model Unit 6 Access Methods Unit 7 Logical Database Design Unit 8 Database Recovery Unit 9 Concurrency Control Unit 10 Security and Integrity Unit 11 Query Optimization Unit 12 Distributed Database 高等資料庫管理 ( 研究所下 )  References: 1. C. J. Date, An Introduction to Database Systems, 8th edition, J. D. Ullman, Principles of Database and Knowledge-Base, Vol.I, Cited papers

Wei-Pang Yang, Information Management, NDHU 0-33 Unit 13 Object-oriented Database Unit 14 Logic-Based Database Unit 15 Image Database Unit 16 Multimedia Database Unit 17 Multidatabase Unit 18 Real-time Database Unit 19 Parallel Database Unit 20 Temporal Database Unit 21 Active Database Unit 22 Bioinformatic Database Unit 23 …. 高等資料庫管理 II ( 研究所 )  References: Cited papers from Journals and conferences

Wei-Pang Yang, Information Management, NDHU 0-34 GenBank Database Growth

Wei-Pang Yang, Information Management, NDHU 0-35 Protein Database Growth

Wei-Pang Yang, Information Management, NDHU 0-36 Entrez  Developed at NCBI, freely available and allow for integrated access to PubMed records, nucleotide and protein sequence data and 3D structure information 

Wei-Pang Yang, Information Management, NDHU 0-37

Wei-Pang Yang, Information Management, NDHU 0-38

Wei-Pang Yang, Information Management, NDHU 0-39 Level 5:Doing Research Level 4:Survey Papers: Special Topics (Unit 13 - ) Level 3:DBMS: Advanced Topics (Unit 7 – 12) Date, Vol. 1, 2 Ullman Level 2:DBMS: Fundamentals (Unit 1 – 6) Date, Vol. 1 Using DB2, Project: Design a “mini” DBMS Level 1:Using DBMS 0.9 Research on Database

Wei-Pang Yang, Information Management, NDHU 0-40  Journals: ACM Trans. On Database Systems (TODS) IEEE Trans. On Software Engineering (TOSE) IEEE Trans. On Knowledge and Data Engineering ACM Trans. On Office Information Systems (TOOIS) Journal of Information Science and Engineering …  Conferences: VLDB (Very Large Data Base) ACM SIGMOD PODS (Principal of Database Systems) IEEE Data Engineering NCS, ICS (National/International Computer Symposium) … Where to find Database papers? Taiwan

Wei-Pang Yang, Information Management, NDHU 0-41  Why Database Systems?  An Architecture for a Database System  Data Models  Components of a Database System  How to establish a Database System?  Discussion and Remarks  Extending Database Technology  Data Structure and Database 課程流程圖  Research on Database DATABASE SYSTEMS : OVERVIEW