We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published byRiley Cross
Modified over 2 years ago
Part of the UK Data Archive and the Arts and Humanities Data Service. Funded by the Joint Information Systems Committee and the Arts and Humanities Research Board. Good Design - © History Data Service1 Databases of Historical Sources: Principles of Good Design Mark Merry History Data Service
Good Design - © History Data Service 2 History as a product History may be thought of as either product or process. As a product, a piece of history consists of a representation of a past reality based upon the interpretation of a body of known facts. Such representations of past realities are always bounded: they treat a subject chosen by the historian which might be static (the situation at point x) or dynamic (how the situation changed between points x and y). Harvey and Press, Databases in Historical Research (1996) Chapter 1
Good Design - © History Data Service 3 What is a database? Basically a computerized record keeping system - that is, a system whose overall purpose is to maintain information and to make that information available on demand C.J. Date, An Introduction to Database Systems. Vol I. Seventh edition (1999) A Database Management System (DBMS) is the computer application built around a database to provide flexible ways of storing, manipulating, and examining the data A DBMS on a personal computer will provide facilities for: –inputting, sharing, modifying, retrieving and deleting data –querying the data (SQL) –producing reports based on the data –building front-ends for users
Good Design - © History Data Service 4 What can databases do for us? Store and organise large amounts of information Provide a surrogate for the original (inaccessible, fragile) source Group physically dispersed material together at one virtual location Provide an environment for manipulating and analysing the content of the original source To search/filter/summarise complex information quickly –Analysis of large amounts of data –Analysis of complex interrelated data Downside: the time and effort needed to convert original sources into a database
Good Design - © History Data Service 5 Source Digitisation Resource The input channels of digitisation (keyboard, scanner etc.) are narrow and can only capture a small proportion of the sources information content identify aspects of source to digitise chose digitisation method chose data model
Good Design - © History Data Service 6 Organising data The field is the basic unit of data in a database. A field stores a single piece of information of a particular data type Fields are combined to form a record. A record matches an entity A set of records with the same fields are collected together in a table
Good Design - © History Data Service 7 Data models Data models are the abstract definitions of structures and relationships used to organise data A DBMS will implement a particular data model Data models can be characterised by how they organise the connections between different records: –flat file –relational –mark-up (hierarchical) Most DBMSs available for personal computers are either flat file or relational
Good Design - © History Data Service 8 Relationships One to one relationships connect one entity to one other entity One to many relationships connect one entity to one or more other entities Many to many relationships connect many entities to many other entities
Good Design - © History Data Service 9 Relationships example
Good Design - © History Data Service 10 Databases of historical sources An historical source based database is a representation of the original source, but it is not an exact replica of the original source –information may be left out –extra information may be included An historical database should: –try to reflect the source accurately and completely –improve the usability of the source –integrate the source with other data (additional sources, coding etc.) NB: these are conflicting aims! An historical source based database mixes elements of a primary source with elements of a secondary source
Good Design - © History Data Service 11 Building databases from historical sources Historians work with information they do not control –incomplete, poorly structured information of varying quality –sources intended for a different purpose –multiple sources not intended to be used in an integrated way Nature of historical sources –ambiguity: the meaning of material may be unclear or dependent on its context –repetition: data is often repeated in different guises –variation: the same item can be referred to using a variety of terms and spellings –variable structure: even apparently well organised sources often have margin notes and other types of random additional data
Good Design - © History Data Service 12 Source information content Simplify the source –Ignore unwanted information –Exclude certain types of information –Select information directly from the source or define a set of summarised information based on the source Model the information content subset –Break information content into discrete elements of information –Describe the characteristics of each information element –Describe how information elements relate to each other Successful source analysis requires a good understanding of the source and of the purpose of the database
Good Design - © History Data Service 13 Source database content fonts columns text spacing page size date issue fold linemarginalia headlines
Good Design - © History Data Service 14 Software & hardware Technical decisions are often the least important Remember that there is nearly always more than one way of doing something with a computer Define what you need to do, then seek technical advice Seek a second opinion! –Technical support staff will often suggest what is most convenient for them, not necessarily you –Commercial companies obviously have their own motives Look for software that supports common standards Avoid little-used software with proprietary features Recognise that hardware may need to be replaced in 2 or 3 years
Good Design - © History Data Service 15 The Three Layer Model Standardisation Layer provides a foundation for analysing the data codes and standardisation rules are applied Source Layer an accurate digital representation of the source defines level of detail captured Interpretation Layer incorporates researchers knowledge and judgement Links records and forms aggregates
Good Design - © History Data Service 16 Three Layer design examples
Good Design - © History Data Service 17 Some simple design hints The smallest unit of data should match the smallest unit of analysis –if you want to look at people by last name then have separate first and last name fields, not just a name field Dont mix data types –separate numbers and words –identify numbers being used as words (addresses) Document everything you do, either in the database or with the database –data entry, data standardisation and coding, data transformations, limits of data, issues of plausibility/probability, coping with uncertainty etc –keep information that tracks the origin and history of the database. Add information, dont delete information Have a backup procedure!
Good Design - © History Data Service 18 Further Information History Data Service web Michael J. Hernandez, Database Design for Mere Mortals : A Hands-On Guide to Relational Database Design, Addison-Wesley, 1997 Charles Harvey & Jon Press, Databases in Historical Research, Macmillan Press, 1996 C. J. Date, An Introduction to Database Systems, Addison-Wesley, 1999 (7th ed.) SearchDatabase.Com: Concordia University: University of Newcastle Database Service:
Part of the UK Data Archive and the Arts and Humanities Data Service. Funded by the Joint Information Systems Committee and the Arts and Humanities Research Board. Good Design - © History Data Service19 web
Good Design - © History Data Service 20 Source Layer Acts as the reference version of the original source. –An accurate representation of the source, including errors, omissions etc. –Contents determine the highest level of detail available about the source in the database –Includes a reference to the non-digital original source –Includes a unique identifier for each item Implementation: –as long text fields containing full text transcriptions –as blob fields containing scanned images
Good Design - © History Data Service 21 Standardisation Layer Organises the information into discrete units with fully defined contents –Separates information in the source into separate fields according to data type and data content –Simplifies the data by standardising and coding it –Normalises the data –Includes links back to the source layer Implementation: –Possibly as addition columns in source layer tables –Probably as separate tables with, ideally, a one-to-one relationship to records in the source layer
Good Design - © History Data Service 22 Interpretation Layer Creates historical entities from the data and the knowledge and expertise of the historian –Incorporates interpolations and extrapolations from the data in the standardisation layer –Selectively includes and excludes information from the standardisation layer –Links separate records to form entities such as individuals or households
History Data Service1 Good Design for Historical source based Databases History Data Service Hamish James.
Using Learning Outcomes and Assessment Criteria Peter Noakes Department of Electronic Systems Engineering University of Essex.
©Ian Sommerville 2000Software Engineering, 6th edition. Chapter 29Slide 1 Chapter 29 Configuration Management.
Relational Database and Data Modeling Lecture 10 (Chapter 4)
1 Data Warehousing Denis Manley Enterprise Systems FT228/3.
Nica Valentin–Danut SEM 2012 Service system fundamentals: Work system, value chain, and life cycle.
Copyright: ©2005 by Elsevier Inc. All rights reserved. 1 Author: Graeme C. Simsion and Graham C. Witt Chapter 3 The Entity-Relationship Approach.
Chapter 6 – Architectural Design 1Chapter 6 Architectural design Software Engineering Ian Sommerville, Software Engineering, 9 th Edition Pearson.
Database Application Lifecycle Lecture Lectures Objectives Put all the previous lectures into context (Conceptual and Logical Design, Normalisation.
DCS209: Introduction to Database Management (I) prepared and delivered by Iya Abubakar Computer Centre (IACC)Ahmadu Bello University, Zaria M-Auwal Gene.
Metadata and Digital Library Development Introduction: Background, Goals, and Course Outline Course design: David Ruddy Cornell University Library 1.
Alter – Information Systems 4th ed. © 2002 Prentice Hall 1 Understanding Systems From a Business Viewpoint.
Infrastructure for E-Business DIS 302: E-Business Laudon & Laudon.
IZA Data Service Center DDI/SDMX Workshop Wiesbaden, Germany, June 18 th 2008 The Data Documentation Initiative (DDI) Arofan Gregory / Pascal Heus
©Ian Sommerville 2000 Software Engineering, 6th edition. Chapter 7 Slide 1 Chapter 7 System Models.
Copyright: ©2005 by Elsevier Inc. All rights reserved. 1 Author: Graeme C. Simsion and Graham C. Witt Chapter 10 Logical Database Design.
1 © 2014 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution in any manner.
Metadata for Digitization and Preservation. Introduction What is metadata and why it matters The key elements How metadata is created Where metadata is.
Database Management. Module 6 Objectives Next Discuss the functions common to most DBMSs Identify the qualities of valuable information Explain why data.
Management Information Systems MANAGING THE DIGITAL FIRM, 12 TH EDITION GLOBAL EDITION FOUNDATIONS OF BUSINESS INTELLIGENCE: DATABASES AND INFORMATION.
Chapter 7 – Design and Implementation 1Chapter 7 Design and implementation Note: These are a modified version of Ch 7 slides available from the authors.
Chapter 6 Architectural Design Slide 1 Chapter 6 Architectural Design.
Achieving AIRS Standards with The AIRS / 211 LA Taxonomy Cathleen Kelly, CRS, CIRS CDK Consulting
Chapter - 5 Understanding Requirements Unit II. Introduction Definition : “The broad spectrum of tasks and techniques that lead to an understanding of.
Introduction to knowledge management. What is knowledge management Knowledge management can be difficult to define, because it encompasses a wide range.
©Ian Sommerville 2004Software Engineering, 7th edition. Chapter 16 Slide 1 User interface design.
1 Note content copyright © 2004 Ian Sommerville. NU-specific content copyright © 2004 M. E. Kabay. All rights reserved. Configuration Management IS301.
University of Sheffield NLP Module 2: Introduction to IE and ANNIE.
© 2017 SlidePlayer.com Inc. All rights reserved.