Presentation is loading. Please wait.

Presentation is loading. Please wait.

Developer Meets Developer March 2011 Chicago, Illinois, USA Roy Zimmer Western Michigan University.

Similar presentations


Presentation on theme: "Developer Meets Developer March 2011 Chicago, Illinois, USA Roy Zimmer Western Michigan University."— Presentation transcript:

1 Developer Meets Developer March 2011 Chicago, Illinois, USA Roy Zimmer Western Michigan University

2 Historic Marcive – most complex load MARC utilities Other utilities Patron cleanup Weekly index regen

3 Historic Details to be found in year 2005 at http://homepages.wmich.edu/ ~zimmer/pres_index.html http://homepages.wmich.edu/ ~zimmer/pres_index.html Hey, it’s award winning work! Marcive

4 Historic Marcive – most complex load MARC utilities Other utilities Patron cleanup Weekly index regen

5 Historic MARC utilities marcedit marcread marccount getmarc splitmarc marcsearch Find them at http://homepages.wmich.edu/~zimmer/marc_index.htmlhttp://homepages.wmich.edu/~zimmer/marc_index.html

6 Historic Marcive – most complex load MARC utilities Other utilities Patron cleanup Weekly index regen

7 Historic Call number sort routine (so-called for sake of brevity, really a parser and normalizer) in a Perl program: require cnparse.lib; @callnumparts = cnparse($callno); To be found at http://homepages.wmich.edu/~zimmer/other_index.htmlhttp://homepages.wmich.edu/~zimmer/other_index.html

8 Historic ratiocheck.pl – database ratio re indexregen rptarchive – cleans up /m1/voyager/$db/rpt scheduled – what cron says should run today To be found at http://homepages.wmich.edu/~zimmer/other_index.htmlhttp://homepages.wmich.edu/~zimmer/other_index.html

9 Historic Marcive – most complex load MARC utilities Other utilities Patron cleanup Weekly index regen

10 Historic Patron cleanup Major patron cleanup – Summer+Fall 2008 Single most current active patron barcode needed due to self-check Details to be found in year 2009 at http://homepages.wmich.edu/~zimmer/pres_index.html http://homepages.wmich.edu/~zimmer/pres_index.html

11 Historic Marcive – most complex load MARC utilities Other utilities Patron cleanup Weekly index regen

12 Historic Weekly index regen Keeps our main database in good order, due to constant loads Yes, I check the log files!

13 Ongoing* – Feeds, Loads, Reports MeLCat Summon VuFind Backstage * There are always some current changes being made to ongoing…

14 Ongoing – Feeds, Loads, Reports MeLCat daily:bib adds and updates patron updates monthly:bib deletes

15 Ongoing – Feeds, Loads, Reports Summon daily extract (adds and updates) yet to come: quarterly full extracts daily deletions

16 Ongoing – Feeds, Loads, Reports VuFind daily:adds and updates weekly:full extracts

17 Ongoing – Feeds, Loads, Reports VuFind Extracts on Voyager coordinated with builds on VuFind machines Feeds go to development, near-production, and production machines catbackup, R.I.P.

18 Ongoing – Feeds, Loads, Reports Backstage quarterly sizeable do-not-send list turn off all load jobs

19 Ongoing – Feeds, Loads, Reports Backstage copy of sent records is marked load these into Voyager while Backstage processing load returned processed records handle Backstage reports turn loads back on

20 Yankee Book Peddler Emery-Pratt Marcive Alexander Street Press Ongoing – Feeds, Loads, Reports

21 All load jobs can be switched on and off Done via a flag file – check for presence Useful for Backstage processing and Voyager upgrades Load jobs always get all available unprocessed files, so that each run fully updates that load Ongoing – Feeds, Loads, Reports

22 Soon to come… getting load data for a particular vendor from a web page, if possible Plan of attack: automate with an interactive LWP session in Perl Ongoing – Feeds, Loads, Reports

23 Finish converting report generation to be entirely automated from Voyager Generate various Batch reports, then rpt2pdf.pl formats each report as needed, resulting in a.PDF file Print from Voyager to our “PC” printers Depositing files on LAN from directly from Voyager yet to come (via Samba) Ongoing – Feeds, Loads, Reports

24 Recent and Current Implemented a local Perl library – contains a handful of common routines now called from programs – slowly starting to convert to this dbpctgraph.pl – generated database ratio graphs – almost ready for automatic emailing

25 Recent and Current dbpctgraph output

26 Recent and Current dbpctgraph output

27 Recent and Current Big Voyager upgrade in December (2010) Voyager Oracle Solaris → to Red Hat Linux machine relocations

28 Recent and Current Technical Services statistics

29 Recent and Current Technical Services statistics How get? Voyager queries, web scraping, VuFind queries

30 Recent and Current - automating annual worksheet data retrieval Over 50 often multipart questions Mostly automating this – voyager queries, some web scraping, some remote database querying, pulling data from a LAN spreadsheet, a bit of manual input, eventually web-based interface

31 Picture © 2006 by Roy Zimmer ExLibris Developer Meets Developer 2011 roy.zimmer@wmich.edu


Download ppt "Developer Meets Developer March 2011 Chicago, Illinois, USA Roy Zimmer Western Michigan University."

Similar presentations


Ads by Google