VLab ( Virtual Laboratory for Earth and Planetary Materials ) A Grid Facility for Computational Mineral Physics.

Slides:



Advertisements
Similar presentations
LEAD Portal: a TeraGrid Gateway and Application Service Architecture Marcus Christie and Suresh Marru Indiana University LEAD Project (
Advertisements

.NET Technology. Introduction Overview of.NET What.NET means for Developers, Users and Businesses Two.NET Research Projects:.NET Generics AsmL.
Test Case Management and Results Tracking System October 2008 D E L I V E R I N G Q U A L I T Y (Short Version)
VLAB Framework (afternoon) Gordon Erlebacher. Principal IT Investigators University of Minnesota –Prof. David A. Yuen : Dept. of Geology and Geophysics.
SYSTEM PROGRAMMING & SYSTEM ADMINISTRATION
VLab: Collaborative Grid Services and Portals to Support Computational Material Science Mehmet Nacar, Mehmet Aktas, Marlon Pierce, Zhenyu Lu, Gordon Erlebacher,
VLab: A Collaborative Cyberinfrastructure for Computations of Materials Properties at High Pressures and Temperatures Cesar R. S. da Silva 1 Pedro R. C.
DEV392: Extending SharePoint Products And Technologies Through Web Parts And ASP.NET Clint Covington, Program Manager Data And Developer Services - Office.
CIM2564 Introduction to Development Frameworks 1 Overview of a Development Framework Topic 1.
VLab: A Cyberinfrastructure for Parameter Sampling Computations Suited for Materials Science Calculations" Cesar R. S. da Silva 1 Pedro R. C. da Silveira.
The Cactus Portal A Case Study in Grid Portal Development Michael Paul Russell Dept of Computer Science The University of Chicago
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
Combining Static and Dynamic Data in Code Visualization David Eng Sable Research Group, McGill University PASTE 2002 Charleston, South Carolina November.
Simple and Intuitive Visualization with the Web Automation and Translation Toolkit (WATT) Client Minnesota Supercomputing Institute Undergraduate Internship.
Chapter 10 Application Development. Chapter Goals Describe the application development process and the role of methodologies, models and tools Compare.
Cambodia-India Entrepreneurship Development Centre - : :.... :-:-
Chapter 3 Software Two major types of software
Computer Software.
.NET, and Service Gateways Group members: Andre Tran, Priyanka Gangishetty, Irena Mao, Wileen Chiu.
Introduction 01_intro.ppt
TeraGrid Gateway User Concept – Supporting Users V. E. Lynch, M. L. Chen, J. W. Cobb, J. A. Kohl, S. D. Miller, S. S. Vazhkudai Oak Ridge National Laboratory.
FALL 2005CSI 4118 – UNIVERSITY OF OTTAWA1 Part 4 Web technologies: HTTP, CGI, PHP,Java applets)
COMPUTER SOFTWARE Section 2 “System Software: Computer System Management ” CHAPTER 4 Lecture-6/ T. Nouf Almujally 1.
4 - 1 Copyright © 2006, The McGraw-Hill Companies, Inc. All rights reserved.
National Center for Supercomputing Applications The Computational Chemistry Grid: Production Cyberinfrastructure for Computational Chemistry PI: John Connolly.
Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski
Magnetic Field Measurement System as Part of a Software Family Jerzy M. Nogiec Joe DiMarco Fermilab.
Fundamentals of Database Chapter 7 Database Technologies.
Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.
QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
The Network Performance Advisor J. W. Ferguson NLANR/DAST & NCSA.
The PROGRESS Grid Service Provider Maciej Bogdański Portals & Portlets 2003 Edinburgh, July 14th-17th.
GEM Portal and SERVOGrid for Earthquake Science PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics, Physics.
Application portlets within the PROGRESS HPC Portal Michał Kosiedowski
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
1 MSCS 237 Overview of web technologies (A specific type of distributed systems)
Framework for MDO Studies Amitay Isaacs Center for Aerospace System Design and Engineering IIT Bombay.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
GVis: Grid-enabled Interactive Visualization State Key Laboratory. of CAD&CG Zhejiang University, Hangzhou
© 2007 IBM Corporation SOA on your terms and our expertise Software WebSphere Process Server and Portal Integration Overview.
Copyright © 2012 UNICOM Systems, Inc. Confidential Information z/Ware Product Overview illustro Systems International A Division of UNICOM Global.
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation NEES TeraGrid.
INFSO-RI Enabling Grids for E-sciencE Graphical User Interface. for Charon Extension Layer System. and Application Dashboards Jan.
© 2013, published by Flat World Knowledge Chapter 10 Understanding Software: A Primer for Managers 10-1.
INFSO-RI Enabling Grids for E-sciencE CHARON System Jan Kmuníček, Petr Kulhánek, Martin Petřek CESNET, Czech Republic.
TeraGrid Gateway User Concept – Supporting Users V. E. Lynch, M. L. Chen, J. W. Cobb, J. A. Kohl, S. D. Miller, S. S. Vazhkudai Oak Ridge National Laboratory.
Some comments on Portals and Grid Computing Environments PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics,
© FPT SOFTWARE – TRAINING MATERIAL – Internal use 04e-BM/NS/HDCV/FSOFT v2/3 JSP Application Models.
CSI 3125, Preliminaries, page 1 SERVLET. CSI 3125, Preliminaries, page 2 SERVLET A servlet is a server-side software program, written in Java code, that.
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
WebFlow High-Level Programming Environment and Visual Authoring Toolkit for HPDC (desktop access to remote resources) Tomasz Haupt Northeast Parallel Architectures.
Intro to Web Services Dr. John P. Abraham UTPA. What are Web Services? Applications execute across multiple computers on a network.  The machine on which.
Tool Integration with Data and Computation Grid “Grid Wizard 2”
AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI How to integrate portals with the EGI monitoring system Dusan Vudragovic.
A computer contains two major sets of tools, software and hardware. Software is generally divided into Systems software and Applications software. Systems.
Chapter – 8 Software Tools.
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
1 Asstt. Prof Navjot Kaur Computer Dept PRESENTED BY.
5/19/05 New Geoscience Applications 1 A DISTRIBUTED WORKFLOW DATABASE DESIGNED FOR COREWALL APPLICATIONS Bill KampBill Kamp, Lumnilogical Research Center,
INFSO-RI JRA2 Test Management Tools Eva Takacs (4D SOFT) ETICS 2 Final Review Brussels - 11 May 2010.
David Adams ATLAS ATLAS Distributed Analysis and proposal for ATLAS-LHCb system David Adams BNL March 22, 2004 ATLAS-LHCb-GANGA Meeting.
Progress Apama Fundamentals
VLAB Framework (afternoon)
Analysis models and design models
VLab (Virtual Laboratory for Earth and Planetary Materials )
A Collaborative Environment
Gordon Erlebacher Florida State University
Gordon Erlebacher Florida State University
Presentation transcript:

VLab ( Virtual Laboratory for Earth and Planetary Materials ) A Grid Facility for Computational Mineral Physics

Principal IT Investigators University of Minnesota – Prof. David A. Yuen : Dept. of Geology and Geophysics Evan F. Bollig Martin F. Lyness Paul Jensen – Prof. Renata Wentzocvitch : Dept. of Chemical Engineering and Materials Science Dr. Cesar da Silva Pedro da Silveira Florida State University – Prof. Gordon Erlebacher : School of Computational Science Indiana University – Dr. Marlon Pierce : IU Community Grids Lab

Photographs David A. Yuen Renata Wentzcovitch Gordon Erlebacher Martin F. Lyness Evan F. Bollig Pedro da Silveira Cesar da Silva Paul Jensen Marlon Pierce

VLab : An Overview On the web: The VLab Portal - Middleware to integrate software across grid computing environments WATT – Automating visualization Web Service generation Sphynx – Simplifying Web Application testing AJAX– Re-thinking the web interface experience. Porky Portal – Real-time workflow monitoring system. Connecting Researchers – Software and technologies that enhance collaboration.

Questions Answered What is VLab? – An interdisciplinary consortium dedicated to the development and promotion of the theory of planetary materials. What will VLab accomplish? – Address materials physics and physical chemistry issues of importance to planetary sciences. – Develop and improve first principles simulations methodologies, integrating highly tested first principles software with utility programs, and creating novel human/software interfaces to facilitate and automate time- consuming human tasks. – Develop an educational program to provide training and bridge the gap between mineral physicists and materials theorists.

VLab Activities On the web: Workshops & Seminars – More to be announced in the Fall Tutorials – Latest Event: First annual VLab Tutorial (5/21-6/3) Summer Research Internship (Univ. of Minnesota) – 8 undergraduate students, each from unique educational disciplines actively participate in research and development of novel technologies for VLab. Nuggets: Short Research Bulletins – Straight to the point updates as we accomplish new goals –

The VLab Portal Large scale molecular dynamics simulations through a simplified grid middleware

Molecular Dynamics with PWscf On the web: Using Plane-Wave self-consistent field (PWscf) First Principles Molecular Dynamics (FP-MD) - Use of quantum mechanics to calculate forces - Electronic structures are calculated with-in Density Functional Theory (DFT) framework - Nuclei positions + electronic structure  forces (accurate) - Nuclei motion follow Newton’s laws of motion Number of atoms, total energy, and volume (N,E,V) are constant. Only atoms can move

Molecular Dynamics with PWscf Variable Cell Shape FP-MD - Cell shape is allowed to change in response to stresses and external pressure - Elastic Strains (Cij) are dynamic variables - In dumped mode PWscf produces configurations (Cell T Atomic Position) at arbitrary external pressure - Stresses and forces are calculated within DFT framework VCS-MD: Cell shapes allowed to change

Job Submission Middleware On the Web: Workflows involve iterations through the following steps: 1) Prepare inputs for applications like PWscf or Phonon, and generate a submission bundle complete with input parameters plus required files. 2) Distribute (via web services) the submission bundles to back-end computation nodes (incl. TeraGrid { }) for execution. 3) Gather results for analysis and refine parameters to reiterate steps 1-3.

Equation Of State, Elasticity (Cij) and Phonon Calculations Example of workflow complexity

Monitoring Submissions Job submissions to various nodes are monitored by a web interface.

ElasVis : Visualization of Elasticity Output On the Web: Integrated into VLab portal to visualize simulation results at end of Cij phase. Uses Java WebStart and JOGL for high performance graphics on distributed clients Web-based reposition scheme for datasets allows results to be committed to permanent storage and retrieved anywhere, anytime. Compare previous simulations with current results and tweak simulations to run again.

Novel Technologies Emerging technologies being integrated into VLab

WATT: An Overview On the Web: wiki/index.php?title=WATT The Web Automation and Translation Toolkit (WATT) Automates the conversion of software, specifically for the internet. Translates source code to incorporate new technologies. Currently supports direct compilation of VTK ( Tcl scripts into remote visualization web services. Three components: the WATT compiler, fcon, and sixpak.

Component 1: The WATT Compiler Uses type-inference to convert type-less Tcl to strictly-typed C++ Compiler is language independent; configuration modules define input and output syntax. Register and Interrupt systems allow the compiler to reconfigure itself as it runs. – Parser for input configuration files registers new types or translations that are immediately available for use. – Interrupts are invoked by registered inputs and result in unique output (i.e. Tcl “set a 1” --> C++ “int a = 1;”)

WATT : Design Tcl scripts written for VTK are sent to our Watt Compiler WATT generates C++ calls for VTK and adds template calls to gSOAP ( gSOAP headers autogenerated by WATT are compiled by the soapcpp2 compiler to produce SOAP enabled C++ objects WATT output plus additional gSOAP output are compiled together to produce a single binary visualization web service

Component 2: FCON FCON is an extensible file conversion utility. The user provides a pattern describing the input and desired output, and FCON generates a program (written in C) to do the conversion. Designed to be system independent, allowing the user to convert files of different endian-ness. FCON module will write file converters as WATT compiles source into web services

Component 3: SIXPAK SIXPAK is the “Simple XML Parsing Kit”. Generates XML parsers and verifiers for the Watt compiler and FCON during runtime. – Reconfigures system without re-running processes SIXPAK goes beyond standard XML to verify the logical correctness of input files. – SIXPAK’s parsers are used while the compiler and FCON run, so correctness is essential.

The WATT Client On the web: A generic client for any VTK ( services generated by WATT Uses JOGL and Java WebStart for fast feedback on client machines. Remote service performs complex visualization, releasing clients from memory and processor requirements imposed by VTK. Shown here with output produced by a charge density simulation in the VLab portal.

Sphynx : Overview On the Web: Automated Unit Testing for web interfaces – Pluggable design for extensions and test classes detected at runtime – Cross platform design based on XML -- Tests are XML descriptions, not blocks of code – Generates reusable test structures to reduce time consumed by unit testing in the past Useful as both a development tool and an end-user feature Anything accessible via http/https streams can be tested

Sphynx: Workflow Diagram Will allow developers to take locally tested copies of their software and generate test suites to verify proper installations on client machines. Extensions allow developers to place code executions at various points in the life cycle. A visual dashboard to report status of individual tests (in development)

Porky Portlet :: Real-time job status monitoring On the Web: Extend current workflow monitoring to add graphical representation of workflow status Retrieve job status from databases or standardized workflow (XML) documents Applications not just for job monitoring in grid applications, but any other field that utilizes workflows (i.e. Sphynx Unit Testing status). Example workflows monitored by Porky Portlet. Green indicates completed-, while Red represents services that have not finished executing.

Yuen Collab On the Web: Intuitive interface allowing easy multi-tasking Use any software you like, modules are loaded in their own environment so virtually any software servable on the web will work! Built in packages with research collaboration in mind. Complete module management system to make administration a cinch

Yuen Collab: Lightning Fast Nobody wants to wait for slow pages to load Ajax and preload technology allow pages to be served like they would on desktop applications by preloading them one on top of another.

VLab: Conclusion The VLab Portal – integrates the a simple web interface with powerful grid computing services – On the Web: WATT – Automates the conversion of software, specifically for the internet. – On the Web: Sphynx – Fast Web Interface test suites – On the Web: AJAX– Bringing the Desktop experience to the Web – On the Web: Porky Portal – Real-time workflow monitoring system. – On the Web: Connecting Researchers – Emphasizing collaboration – On the Web: