Report from Metadata Working Group ILDG7 (Dec.08,2005) T.Yoshie for MDWG CCS,Tsukuba ILDG6  file format was proposed and approved  QCDml1.1 had been.

Slides:



Advertisements
Similar presentations
Configuration Management
Advertisements

E-Portfolio July2014 Managing Multi-source Feedback.
0 Chicago, IL March 6 th, 2007 Use Case Requirements, Design and Standards Selection HITSP Use Case Requirements, Design and Standards Selection Date:
1 Unit & District Tools Phase 1. 2 To access the new Unit and District Tools, you will need to click on the link embedded in the MyScouting Flash page.
MP IP Strategy Stateye-GUI Provided by Edotronik Munich, May 05, 2006.
1 Lesson 14 Sharing Documents Computer Literacy BASICS: A Comprehensive Guide to IC 3, 3 rd Edition Morrison / Wells.
SRDC Ltd. 1. Problem  Solutions  Various standardization efforts ◦ Document models addressing a broad range of requirements vs Industry Specific Document.
Page 1 of 16 The Work in Progress screen is accessed from the ETS main menu. The screen will be displayed when a user clicks on the ‘Work in Progress’
Achieving Distributed Extensibility and Versioning in XML Dave Orchard W3C Lead BEA Systems.
NOAO/Gemini Data workshop – Tucson,  Hosted by CADC in Victoria, Canada.  Released September 2004  Gemini North data from May 2000  Gemini.
Sharing Lattices Throughout the World: An ILDG Status Report ILDG July 31, 2007.
XML File Format Used By LOR2 to Save Sequences The XML format used by LOR2 makes it easier for users to view and edit a sequence file outside of LOR with.
© Siemens Product Lifecycle Management Software Inc. All rights reserved Siemens PLM Software Solid Edge ST4 Training Revising assemblies.
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
TIBCO Designer TIBCO BusinessWorks is a scalable, extensible, and easy to use integration platform that allows you to develop, deploy, and run integration.
MS Access: Database Concepts Instructor: Vicki Weidler.
DAY 21: MICROSOFT ACCESS – CHAPTER 5 MICROSOFT ACCESS – CHAPTER 6 MICROSOFT ACCESS – CHAPTER 7 Akhila Kondai October 30, 2013.
Form Builder Iteration 2 User Acceptance Testing (UAT) Denise Warzel Semantic Infrastructure Operations Team Presented to caDSR Curation Team March.
Copyright © 2011 Pearson Education, Inc. Publishing as Prentice Hall.
Preparation and processing of in-session documents.
DAY 15: ACCESS CHAPTER 2 Larry Reaves October 7,
ILDG5QCDgrid1 QCDgrid status report UKQCD data grid Chris Maynard.
Lattice 2004Chris Maynard1 QCDml Tutorial How to mark up your configurations.
T Network Application Frameworks and XML Web Services and WSDL Sasu Tarkoma Based on slides by Pekka Nikander.
Dr Chris Maynard Application Consultant, EPCC Muttering about metadata Report from the Metadata work group.
February 1 & 31 Csci 2111: Data and File Structures Week4, Lectures 1 & 2 Fundamental File Structure Concepts & Managing Files of Records.
Moodle (Course Management Systems). Assignments 1 Assignments are a refreshingly simple method for collecting student work. They are a simple and flexible.
 2008 Pearson Education, Inc. All rights reserved Introduction to XHTML.
FIGIS’ML Hands-on training - © FAO/FIGIS An introduction to XML Objectives : –what is XML? –XML and HTML –XML documents structure well-formedness.
XML A web enabled data description language 4/22/2001 By Mark Lawson & Edward Ryan L’Herault.
Progress with migration to SVN Part3: How to work with g4svn and geant4tags tools. Geant4.
Bookkeeping Tutorial. Bookkeeping & Monitoring Tutorial2 Bookkeeping content  Contains records of all “jobs” and all “files” that are created by production.
ILDG Middleware Status Chip Watson ILDG-6 Workshop May 12, 2005.
Lattice QCD Data Grid Middleware: status report M. Sato, CCS, University of Tsukuba ILDG6, May, 12, 2005.
Using the Right Method to Collect Information IW233 Amanda Murphy.
Dr Chris Maynard Application Consultant, EPCC Tools for ILDG.
Report from Metadata Working Group ILDG9 (Dec.01,2006) T. Yoshie for MDWG CCS,Tsukuba ILDG8  QCDml1.3 solved all known issues, except “action normalization”
1 Updates of the QCDml ILDG11 (Nov.30,2007) T. Yoshie for MDWG CCS,Tsukuba revised the QCDml twice Ensemble1.4.1 (June 03) anisotropic action, link smearing.
Agenda Basic concepts and demo in service portal (search KB articles)
Marking up lattice QCD configurations and ensembles for ILDG Metadata Working Group P.Coddington, B.Joo, C.Maynard, D.Pleiter, T.Yoshie Working group members.
1 Metadata Working G roup Report Members (fixed in mid-January) G.AndronicoINFN,Italy P.CoddingtonAdelaide,Australia R.EdwardsJlab,USA C.MaynardEdinburgh,UK.
Lattice QCD Data Grid Middleware: Meta Data Catalog (MDC) -- CCS ( tsukuba) proposal -- M. Sato, for ILDG Middleware WG ILDG Workshop, May 2004.
Spanish WFD article 13 reporting Group D meeting April 28th 2010 Brussels.
USQCD regional grid Report to ILDG /28/09ILDG14, June 5, US Grid Usage  Growing usage of gauge configurations in ILDG file format.  Fermilab.
1 Metadata WG Status Report QCDML v1.0 –proposed at ILDG4 (May,2004) –presented at Lattice 2004 (talk: Dirk Pleiter, tutorial: Chris.
Bookkeeping Tutorial. 2 Bookkeeping content  Contains records of all “jobs” and all “files” that are produced by production jobs  Job:  In fact technically.
(A comparative study for XML change detection) Grégory Cobéna (INRIA), Talel Abdessalem (ENST), Yassine Hinnach (ENST) Etude comparative sur la détection.
Slide #1 Nov 6 – 11, 2005XCON WG IETF54 Conference Package Extensions draft-levin-xcon-conference-package-ext-00 by Orit Levin The Discussion Starter.
May 2005 PPARC e-Science PG School1 QCDgrid Chris Maynard A Grid for UKQCD National collaboration for lattice QCD.
Copyright © 2007, Oracle. All rights reserved. Using Document Management and Collaboration Appendix B.
External Interface Update 1 External Interface Update April 2, 2007 Daryl Shing.
GJXDM Tool Overview Schema Subset Generation Tool Demo.
Managing TDM Drawings Lifecycle WorkFlow Created: March 30, 2006 Updated: April 10, 2006 By: Tony Parker.
20 October 2005 LCG Generator Services monthly meeting, CERN Validation of GENSER & News on GENSER Alexander Toropin LCG Generator Services monthly meeting.
1 Updates to the QCDml and sharing quark propagators ILDG12 (May.23,2008) T. Yoshie for MDWG CCS,Tsukuba two revisions to QCDml  new actions overlap quark.
MICROSOFT ACCESS – CHAPTER 5 MICROSOFT ACCESS – CHAPTER 6 MICROSOFT ACCESS – CHAPTER 7 Sravanthi Lakkimsety Mar 14,2016.
Text2PTO: Modernizing Patent Application Filing A Proposal for Submitting Text Applications to the USPTO.
ILDG MDWG report Chris Maynard. ILDG Status QCDml1.3  Issues outstanding at ILDG7 –Management –Ensemble observables –Valid.
H2LC The Hitchhiker's guide to LSA Core Rule #1 Don’t panic.
Unit & District Tools Phase 1
Lesson 9 Sharing Documents
Lesson 9 Sharing Documents
ILDG Implementation Status
Technical update 05 of April 2017
8 EGR preliminary frame and validation tasks
New input for CEOS Persistent Identifier Best Practices
S-127 – Marine Traffic Management Release Candidate NIPWG 6 30 January 2019 Raphael Malyankar Eivind Mong Sponsored by IHO.
Lesson 14 Sharing Documents
WebDAV Design Overview
PSS0 Configuration Management,
Presentation transcript:

Report from Metadata Working Group ILDG7 (Dec.08,2005) T.Yoshie for MDWG CCS,Tsukuba ILDG6  file format was proposed and approved  QCDml1.1 had been stable ILDG7  propose an update of QCDml improved management part of QCDml marked up new lattice actions  summary of on-going discussions observables, validity of schemata  other issues

Management of QCDml1.1QCDml1.1 strategy of QCDml1.1  we record all events of “addition/removal of configurations” to/from the ensemble, using management part of IDs. management revisions archiveHistory elem revisionrevisionActionnumberConfigs  : total number of revisions  : sequential number (= in config XML)  : add/remove of configurations  : #config processed in this revision  includes other info (person, date,…)

Management: requirements new requirements: we want to  write an ensemble XML ID when config generation starts  avoid frequent change of ID suppose we add configuration one by one. long list of archiveHistory  store ID written by users to MDC without further changes for QCDml1.1, a tool to generate archiveHistory consistently has to be developed, and the user ID has to be processed by the tool. Good properties we don’t want to change:  #configs belonging to an ensemble can be counted.  replace/remove of configs can be detected by users  modification of ID can be detected by users  a kind of time stamps is recorded change of existing IDs has to be minimal

Management: solution (1) ensemble XML  and all ’s in are optional management revisions archiveHistory elem revisionrevisionAction  when one records optional archiveHistory elem’s: refers to a revision of XML ID add: addition of ID to MDC, replace: replace of ID in MDC remove: remove of ID from MDC is removed, i.e. add/remove of configs to/from an ensemble is not recorded in the ensemble XML ID. numberConfigs

Management: solution (2) configuration XML  one in archiveHistory (generate) is mandatory  others optional management revisions archiveHistory  when optional archiveHistory elem’s are recorded add/replace/remove refer to either ID or config. elem revision=0 revisionAction = generate includes info. of person, date

Management: solution (3) new management parts satisfy “new requirements”. It also keeps old important properties, even if optional elements are not marked up.  write an ensemble XML ID when config generation starts  avoid frequent change of ID Yes, because coupling between ensemble IDs and config IDs was removed  ID written by a user is not changed when it is stored in MCD Yes, if one does not record archiveHistory. One may authomatically update the archiveHistory, when IDs are stoared in MDC.  #configs belonging to an ensemble can be counted. count #config IDs with markovChainURI as a key  replace/remove of configs can to be detected by users when replaced, crcCheckSum and hence config ID will be modified  modification of ID can be detected by users users have to keep copies of ensemble/config IDs  a kind of time stamps is recorded revisionAction=generate with a time stamp is mandatoy in config ID

Management: more improvement is proposed by MILC collab. classify ensembles lover level classification (optional) Ensembles generated by a project are usually classified by e.g. lattice spacing (coarse, fine, superfine), lattice size (small, medium, large). enables to mark up such lower-level grouping

Convention to mark up sixLink actions gluon plaquette sixLink iwasakiRG DBW2 LuescherWeisz tpLuescherWeisz treeLevelSymanzik plaq. rect. chair 3d  c3 was missing in QCDml1.1  we mandate c3, though redundant New action: gluon

quark KS overlap wilson improved KS askTad domainWall wilsonTm clover npClover tpClover Requests of marking up other actions, write to us New action: quark

QCDml1.2.0 modification from the old version is minor the new one is not compatible with the previous QCDml1.1  compatible: if IDs written based on the old schema are still valid under the new one. strategy to name and treat new QCDml schema release QCDml1.2.0 major/minor version  if not-compatible, count-up major/minor version number  if compatible, count-up release number. All releases (with the same version number) belongs to the same name space, e.g. QCDml1.2.x has targetNamespace="

On-going: observables a request to markup observables e.g. lattice spacing useful for users to search ensembles conceptually (qualitatively) different from what we have marked up.  Ensemble ID: how the ensemble was generated  Observables: properties (consequences) of the ensemble Thus, deliberate action is necessary summary of discussions up to now  Some kind of observables are not property of ensemble. E.g. Lattice spacing, if it is determined by chiral extrapolations.  Dimension-full quantities are dangerous. They depend on inputs.  Values of observables change, when more configurations are added.  what kind of observables are worth marking up. pion prop maynot be.  candidate: pi-rho ratio and sommer scale in lattice units plan to come to conclusions within a month or so.

Validity of Schemata current version of QCDml is not valid under W3C definition strategy to express hierarchical structure of lattice actions  action: complexType, derived action: substitution of complexType  content model of the new type has to be restriction/extension of that of the old one. Current QCDml violates this rule validation of schema does not work properly with XMLspy5 QCDml does not pass XMLspy2006 and W3C… validators. causes no serious problem for usual use of QCDml  validation of ID works correctly  Xpath(1.0) query does not refer to schemata working to write a new valid schema not completed yet, but expect required changes to be backward compatible  inheritance of actionTypes is valid (action hierarchical tree unchanged)  elements in IDs are unchanged (users don’t have to do anything)

Other Issues and Future Works procedure to release new schemata (almost agreed by WG)  user wants to markup his/her ensemble generated with a new action  write a request to the MDWG  a MDWG member (or the user) writes a schema for the new action and circulates it to the MDWG mail-list  the proposal of change is automatically accepted if there is no objection circulated within a certain period of time (e.g. 2 weeks)  Chris Maynard volunteers final editing of schemata  we put the new release somewhere at the ILDG web-page  and announce new schemata via ILDGNews blog of the ILDG web- page or other mail-lists write glossary for marked-up actions write human readable document or guidebook, like “How to markup QCD ensembles and configurations”

Summary New version of QCDml (QCDml1.2) was released  Dirk Pleiter volunteered to write this version. Discussion is on-going on whether/how we extend QCDml to include observables.  feedback of your opinions/comments are welcome Work is in progress to write schemata compatible with W3C definition  Chris Maynard is tackling this issue Mail list is closed to members only.  write to if you want your mail address be included, or you send your opinions/comments to  mails are archived at