The BinX API eDIKT project team May 2003 Ted Wen Robert Carroll

Slides:



Advertisements
Similar presentations
E-Science Data Information and Knowledge Transformation BinX An edikt Project Testbed Ted Wen, Robert Carroll, Denise Ecklund, Bob Gibbins, Davy Virdee,
Advertisements

Introduction to the BinX Library eDIKT project team Ted Wen Robert Carroll
Data formats in e-Science Two key requirements Two key requirements –Interoperability and Scalability –XML is flexible, but verbose –Binary formats are.
E-Science Data Information and Knowledge Transformation BinX – A Tool for Binary File Access eDIKT project team Ted Wen
Question Bank. Explain the syntax of if else statement? Define Union Define global and local variables with example Concept of recursion with example.
1/1/ / faculty of Electrical Engineering eindhoven university of technology Managing complex designs Workshop on VLSI Design Using the Interactive Design.
1 XSLT – eXtensible Stylesheet Language Transformations Modified Slides from Dr. Sagiv.
SYSTEM PROGRAMMING & SYSTEM ADMINISTRATION
Ch. 5 Web Page Design – Templates and Style Sheets Mr. Ursone.
E-Science Data Information and Knowledge Transformation The BinX Language.
WSDL Park, Hyunho 2005/07/28. Introduction Web services have been around for a long time in primitive form. Limitation of the primitive form:
SOCATS STL-based Object Caching And Transport System.
XML Parsing Using Java APIs AIP Independence project Fall 2010.
Characteristics of Realtime and Embedded Systems Chapter 1 6/10/20151.
Concepts of Version Control A Technology-Independent View.
METS What is METS ? What is METS ? A schema that provides a flexible mechanism for encoding descriptive, administrative, and structural metadata for a.
4 Copyright © 2004, Oracle. All rights reserved. Creating a Basic Form Module.
Outline Chapter 1 Hardware, Software, Programming, Web surfing, … Chapter Goals –Describe the layers of a computer system –Describe the concept.
Monday, 11/18/02, Slide #1 CS 106 Intro to CS 1 Monday, 11/18/02  QUESTIONS??  Today:  Hand back, discuss HW #4  Discussion of Lab 10  Exam #2 Friday.
BinX and Astronomy Bob Mann Institute for Astronomy and National e-Science Centre.
HDF 1 NCSA HDF XML Activities Robert E. McGrath Mike Folk National Center for Supercomputing Applications.
C o n f i d e n t i a l Developed By Nitendra NextHome Subject Name: Data Structure Using C Title: Overview of Data Structure.
Chapter 12 Creating and Using XML Documents HTML5 AND CSS Seventh Edition.
Programming Languages: Telling the Computers What to Do Chapter 16.
Avro Apache Course: Distributed class Student ID: AM Name: Azzaya Galbazar
SSC2: Web Services. Web Services Web Services offer interoperability using the web Web Services provide information on the operations they can perform.
Lattice 2004Chris Maynard1 QCDml Tutorial How to mark up your configurations.
XML eXtensible Markup Language by Darrell Payne. Experience Logicon / Sterling Federal C, C++, JavaScript/Jscript, Shell Script, Perl XML Training XML.
Zhonghua Qu and Ovidiu Daescu December 24, 2009 University of Texas at Dallas.
School of Computing and Management Sciences © Sheffield Hallam University To understand the Oracle XML notes you need to have an understanding of all these.
Visual Linker Final presentation.
Software Design 13.1 XML: Another TLA or the Future? XML is eXtensible Markup Language  It's a w3c standard.
© 2006 IBM Corporation IBM WebSphere Portlet Factory Architecture.
Empowering the User Custom Web Reporting M. Keener & R. Kolatalo | Thursday, March 1, 2012.
JSTL, XML and XSLT An introduction to JSP Standard Tag Library and XML/XSLT transformation for Web layout.
Axel Naumann University of Nijmegen / NIKHEF, NL ROOT 2004 Users Workshop The Future of THtml Plans and Status of ROOT’s documentation facility.
4 Copyright © 2004, Oracle. All rights reserved. Creating a Basic Form Module.
The european ITM Task Force data structure F. Imbeaux.
1 HTML Frames
Visual Linker Prototype presentation.
_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community.
1 5. Abstract Data Structures & Algorithms 5.2 Static Data Structures.
Documentation javadoc. Documentation not a programmer's first love lives in a separate file somewhere usually a deliverable on the schedule often not.
AUKEGGSWorkshop ANU, Canberra, 29 November 2006 Implementing CSML Feature Types in applications within the NERC DataGrid Dominic Lowe, British Atmospheric.
1 Metadata Working G roup Report Members (fixed in mid-January) G.AndronicoINFN,Italy P.CoddingtonAdelaide,Australia R.EdwardsJlab,USA C.MaynardEdinburgh,UK.
Structural Design Software TYLER HUTCHISON. Requirements  Develop an interface to generate a text file.  The text file is then passed to one of five.
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
E-Science Data Information and Knowledge Transformation BinX – A Tool for Binary File Access eDIKT project team Ted Wen
Overview of Previous Lesson(s) Over View 3 Program.
Documenting LabVIEW Data & Data Mining with LabVIEW and DIAdem Presentation with self paced training exercises.
Digital Data Preservation: a schema-driven model Student: Stacy Kowalczyk Co-Authors: Clare McInerney and Phil Mitchell Digital Data Preservation – the.
Microsoft Foundation Classes
Design Overview. Generated Packages ► fUML.Library.* - generated ► fUML.Semantics.* - generated ► fUML.Syntax.* - generated ► fUML.Test.* - generated.
Ganga/Dirac Data Management meeting October 2003 Gennady Kuznetsov Production Manager Tools and Ganga (New Architecture)
D Copyright © 2004, Oracle. All rights reserved. Using Oracle XML Developer’s Kit.
Chapter 8 Adding Multimedia Content to Web Pages HTML5 & CSS 7 th Edition.
1 Model Driven Health Tools Design and Implementation of CDA Templates Dave Carlson Contractor to CHIO
XML & JSON. Background XML and JSON are to standard, textual data formats for representing arbitrary data – XML stands for “eXtensible Markup Language”
Creation and Visualization of 3D Scenes with the MRPT library January, 2007 Jose Luis Blanco Claraco Dept. of Automation and System Engineering University.
1 THE OBJECT-ORIENTED TECHNOLOGY: An Executive Summary 서울대학교 컴퓨터공학부 Internet Database Lab 교수 김형주 Spring 2007.
Hex Editing using HxD Nick Fogal & Lindsay Shaffer.
Windows App Studio Windows App Studio is the tool that makes it fast and easy to build Windows 10 apps. It’s accessible from any device with a browser.
Chapter 3 Data Representation
A C++ generic model for the GLAST Geometric Description
PRG 421 GUIDE Lessons in Excellence -- prg421guide.com.
PRG 421 GUIDE Education for Service-- prg421guide.com.
Binary Files.
Updates on the XSLT stylesheets for DDI
Editing Attachment Names in COMMBUYS
5/14/ :08 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN.
Presentation transcript:

The BinX API eDIKT project team May 2003 Ted Wen Robert Carroll

Contents Format of the BinX document Format of the BinX document The binary data file The binary data file BinX data types BinX data types Format of the dataBinX document Format of the dataBinX document BinX library API BinX library API

A BinX document Root element Data class section Data instance section Abstract data type

The BinX document <short-16/><integer-32/><ieeeDouble-64/></file></dataset>

Another BinX document … … <definitions> <arrayFixed><byte-8/> </definitions> </dataset>

The binary data file DataBinX<short-16>100</short-16><integer-32>10000</integer-32> Binary Data Hexadecimal

BinX Data Types

Primitive data types BxByte8 BxCharacter8 BxShort16 BxInteger32 BxLong64 BxUnsignedShort16 BxUnsignedInteger32 BxUnsignedLong64 BxFloat32 BxDouble64 BxExtended80 BxQuadruple128

Complex data types BxDataset BxUnion BxArrayFixed BxArrayVariable BxArrayStreamed

User type definition <struct></struct></defineType> <arrayFixed></arrayFixed></defineType> <union></union></defineType>

DataBinX Document

Primate types in DataBinX <file><short-16>32</short-16><integer-32>100</integer-32><ieeeDouble-64>50.5</ieeeDouble-64></file></dataset>

Struct in DataBinX … …

Array in DataBinX <arrayFixed><byte-8/> </arrayFixed><arraydata> </arraydata>

BinX Library API

Parsing a BinX document BxBinxFile* pReader = new BxBinxFile(); If (pReader->parse(“mybinx.xml”)) { BxDataset* pDataset = pReader->getDataset(); }

Output from the library DataBinX DataBinX The combined data and BinX document SchemaBinX SchemaBinX Binary data stream Binary data stream DataBinX = SchemaBinX + Binary data

Creating BinX document BxBinxFileWriter* pWriter=new BxBinxFileWriter(); Create a object to write out the document Create a object to write out the document BxDataset* pData = new BxDataset(); Create a new dataset (in memory BinX document) Create a new dataset (in memory BinX document) BxShort16* i16 = new BxShort16(100); pData->addDataObject(i16); Add data to the dataset Add data to the dataset

Creating BinX document BxBinaryFile* pbf = new BxBinaryFile(); Create a new binary file Create a new binary filepbf->setDatasetPointer(pData); Create a link to the BinX document Create a link to the BinX document pWriter->setBinaryFilePtr(pbf); pWriter->save("TestDataset.xml"); Save the BinX document Save the BinX document

Merge binary data BxBinxFileReader * pFile1 = new BxBinxFileReader(“file1.xml”); BxBinxFileReader * pFile2 = new BxBinxFileReader(“file2.xml”); BxDataset * pDataset1 = pFile1->getDataset(); BxDataset * pDataset2 = pFile2->getDataset(); BxArray * pArray1 = pDataset1->getArray(0); BxArray * pArray2 = pDataset2->getArray(0); BxDataObject * pData1 = pArray1->getNext(); BxDataObject * pData2 = pArray2->getNext(); FILE * fo = fopen(“output.dat”,”wb”); pData1->toStreamBinary(fo);pData2->toStreamBinary(fo);

Summary One BinX document can describe One BinX document can describe many binary files Generate BinX document from code Generate BinX document from code Easy to use interfaces Easy to use interfaces Flexible Flexible