Presentation is loading. Please wait.

Presentation is loading. Please wait.

EMu Museum Victoria The bird that never sleeps Donna Fothergill David Zhang View from Nicholson St, blades featuring Melbourne Museum venue branding.

Similar presentations


Presentation on theme: "EMu Museum Victoria The bird that never sleeps Donna Fothergill David Zhang View from Nicholson St, blades featuring Melbourne Museum venue branding."— Presentation transcript:

1 EMu 24/7 @ Museum Victoria The bird that never sleeps Donna Fothergill David Zhang View from Nicholson St, blades featuring Melbourne Museum venue branding. Photographer: Jennifer McNair Date: June 2007 Source: Museum Victoria MV Images

2 Overview Why? The decision to make EMu available 24/7 at Museum Victoria How? The Infrastructure making this possible (hardware/scripts/resources) Whats Next? Other Tools Eight-hour day banner, Melbourne, 1856 Date: 1856 Source: Museum Victoria MV Images

3 The MV EMu Guarantee In the event of: Primary Server Crash System/Database Maintenance EMu upgrades EMu available 24/7 Quote: we can rebuild him, we have the technology -Oscar Goldman

4 Importance System Integration - MV Images - MVWISE Live Feeds - e.g. The Learning Federation Online collections - e.g. Natural Sciences Core business system EMu Figurine Photographer: David Paul Date: 11/07/2011 Source: Museum Victoria MV Images

5 + = EMu Mobile Technology MVWISE EMu in the palm of your hand

6 MV Images Butterflies on Display: Bugs Alive! Exhibition : Melbourne Museum Photographer: Andrew Curtis Date: 03/09/2010 Source: Museum Victoria MV Images

7 EMu Core database for all Collection items MVWISE Application for location and inventory control MV Images Digital asset management system for all digital images and audio in the State Collection and other resources Full synchronisation – desktop and handheld devices Data sharing using iMu web services Systems Integration

8 Live Data Feeds The Learning Federation

9 Online Collections Search Natural Sciences Collections

10 Remote Access regardless of connection, location or device

11 Extending Access Fieldwork Projects/Special Projects Out of Hours Availability Testing environments Where ever Internet Access is available, so too is EMu! Where ever Internet Access is available, so too is EMu! The Moon, from a Photograph taken by the Great Melbourne Telescope, Date: 1874: Source: Museum Victoria MV Images

12 Primary Server Failure Synchronisation Maintenance/Upgrades Snapshot

13 Backend processes EMu is synchronised from live server to backup server every hour Full EMu access is available using the EMu client (except during maintenance) Snapshot taken of backup service prior to maintenance During maintenance, the access becomes read-only. Quote: (EMu)... looks good at the front, but has a big backend Anonymous!

14 Infrastructure Live EMu Server EMu Synchronisation process Changes to live EMu are transported to EMu on the backup server Backup EMu Server Email notification sent to support staff Data processing is carried out on the backup server for fast synchronisation Primary Server Dedicated 10 GB link and RAM for synchronisation temp space

15 Synchronisation Performance Tue Aug 30 12:02:05 EST 2011...start emu sync to backup server Tue Aug 30 12:02:05 EST 2011...stop emu load Tue Aug 30 12:02:11 EST 2011...get all the deletions search for new/changed multimedia objects Tue Aug 30 12:02:18 EST 2011... start searching new img Tue Aug 30 12:02:19 EST 2011...start exporting modified/new records Tue Aug 30 12:02:22 EST 2011...move data to backup server Tue Aug 30 12:02:25 EST 2011...moving loads directory to backup server Tue Aug 30 12:02:25 EST 2011...restart backgroud load Tue Aug 30 12:02:26 EST 2011...finish sync on bronte Live EMu service = 75GB

16 Synchronisation Summary A dedicated private link and RAM for temp space Data processing is deferred to the backup server It takes less than 30 seconds for synchronisation to complete Checks and whistles in place to avoid data corruption

17 Infrastructure Live EMu Service EMu Snapshot prior to maintenance Backup of live EMu Service Live EMu is synched to the Backup server Backup Server Primary Server Snapshot EMu is read only Snapshot EMu is read only Snapshot created from backup of live EMu Service Service changes from emu to snapshot EMu And back again when maintenance completes Maintenance is carried out on Live EMu Maintenance is carried out on Live EMu

18 Snapshot Summary Live EMu is synched to backup server The snapshot is taken from the backup live service and placed on the primary server. It is a read only copy of the live service. New connections and/or requests after 5pm are directed to the snapshot When maintenance is complete, the service switches back to the live service. Synchronisation process starts again Camera - Parisio Cantini Empoli, Bellows Glass Plate, circa 1880 Photographer: Taryn Ellis Date: 03/11/2010 Source: Museum Victoria MV Images

19 Whats Next? Live EMu 24/7 ?

20 Other Tools Managing our large data files fupdateCompactSort Update load/data file compaction tool fselect Recover Deleted Records getDbRefDetails Delete batches of records in the backend

21 fupdateCompactSort Example: update 80 fields in 284,297 catalogue records + compaction Example: update 80 fields in 284,297 catalogue records + compaction Data file texload texcompact Index Rebuild Data file Update + Compaction Update + Compaction 1 hour 37 minutes Index Rebuild < 1 minute

22 getDbRefDetails delete batches of records /usr/local/emu/bin/getDbRefDetails etaxonomy Primary DB = "etaxonomy"; Linked Modules ecatalogue => TaxTaxonomyRef_tab 10 BirCuckooRef 1 IdeFiledAsRef 1 enarratives => TaxTaxaRef_tab 45 SpeLookalikesRef_tab 20 etaxonomy => HisAccNameRef_tab 20 TaxAvailabilityCorrectNameRef_tab 20 HomNameRef_tab 20 TaxAvailabilityCompetingHomRef_tab 20 ClaCurrentNameRef 1 PriTypeAboveSpeciesNameRef 1 ClaHybridParent2NameRef 1 SynNameRef_tab 100

23 fselect Recover deleted records usage: fselect [options] dbname Options are: -d alternative data file -D print out ins forms -Sstatus record status -c set the status of selected records to current -a analyse -kirn get the records with this irn -un get nth record with this irn -fFile save processed records into File Computer Walking and Talking Photographer: Frey Micklethwait Date: June 2011 Source: Museum Victoria MV Images


Download ppt "EMu Museum Victoria The bird that never sleeps Donna Fothergill David Zhang View from Nicholson St, blades featuring Melbourne Museum venue branding."

Similar presentations


Ads by Google