SWIM WEB PORTAL by Dipti Aswath SWIM Meeting ORNL Oct 15-17, 2007.

Slides:



Advertisements
Similar presentations
PRAGMA BioSciences Portal Raj Chhabra Susumu Date Junya Seo Yohei Sawai.
Advertisements

GridWorld 2006 Use of MyProxy for the FusionGrid Mary Thompson Monte Goode GridWorld 2006.
IRRA DSpace April 2006 Claire Knowles University of Edinburgh.
LEAD Portal: a TeraGrid Gateway and Application Service Architecture Marcus Christie and Suresh Marru Indiana University LEAD Project (
Remote Visualisation System (RVS) By: Anil Chandra.
Unveiling ProjectWise V8 XM Edition. ProjectWise V8 XM Edition An integrated system of collaboration servers that enable your AEC project teams, your.
SWIM Portal Feedback & Data Management Needs Gheni Abla Eliot Feibush Job Monitor.
Academic Technology Services The UCLA Grid Portal - Campus Grids and the UC Grid Joan Slottow and Prakashan Korambath Research Computing Technologies UCLA.
Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.
MDSplus Tom Fredian MIT Plasma Science and Fusion Center.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
The Cactus Portal A Case Study in Grid Portal Development Michael Paul Russell Dept of Computer Science The University of Chicago
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
Components and Architecture CS 543 – Data Warehousing.
Report Distribution Report Distribution in PeopleTools 8.4 Doug Ostler & Eric Knapp 7264.
Alarms and Events - Processing and Logging Project Mentors Suneel Kumar Venugopal Vanga.
Web-Enabling the Warehouse Chapter 16. Benefits of Web-Enabling a Data Warehouse Better-informed decision making Lower costs of deployment and management.
Next Generation Trnsport Presented by Paul Neumann, TTF Chair, Colorado DOT Ian Baldwin, Info Tech, Inc. November 2005.
Catania Science Gateway Framework Motivations, architecture, features Catania, 09/06/2014Riccardo Rotondo
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
CONNECT as an Interoperability Platform - Demo. Agenda Demonstrate CONNECT “As an Evolving Interoperability Platform” –Incremental addition of features.
Talend 5.4 Architecture Adam Pemble Talend Professional Services.
LHC Experiment Dashboard Main areas covered by the Experiment Dashboard: Data processing monitoring (job monitoring) Data transfer monitoring Site/service.
Module 10: Designing an AD RMS Infrastructure in Windows Server 2008.
GRAPPA Part of Active Notebook Science Portal project A “notebook” like GRAPPA consists of –Set of ordinary web pages, viewable from any browser –Editable.
EXtensible Neuroimaging Archive Toolkit (XNAT) Washington University Neuroinformatics Group.
MAHI Research Database Data Validation System Software Prototype Demonstration September 18, 2001
Using the SAS® Information Delivery Portal
Digital Object Architecture
M i SMob i S Mob i Store - Mobile i nternet File Storage Platform Chetna Kaur.
Towards a Javascript CoG Kit Gregor von Laszewski Fugang Wang Marlon Pierce Gerald Guo
Jeff Shiley. Start Point System Environment User Experience Our “Unique” Requirements Solution System Evaluation & Prototype Single Sign-on Component.
SITools Enhanced Use of Laboratory Services and Data Romain Conseil
GridChem-- User Support Kent Milfeld Supported by the NSF NMI Program under Award # Oct. 10, 2005.
Long Term Ecological Research Network Information System LTER Grid Pilot Study LTER Information Manager’s Meeting Montreal, Canada 4-7 August 2005 Mark.
Service Computation 2010November 21-26, Lisbon.
ESP workshop, Sept 2003 the Earth System Grid data portal presented by Luca Cinquini (NCAR/SCD/VETS) Acknowledgments: ESG.
Through the development of advanced middleware, Grid computing has evolved to a mature technology in which scientists and researchers can leverage to gain.
Microsoft SharePoint Server 2010 for the Microsoft ASP.NET Developer Yaroslav Pentsarskyy
The Network Performance Advisor J. W. Ferguson NLANR/DAST & NCSA.
1 st December 2003 JIM for CDF 1 JIM and SAMGrid for CDF Mòrag Burgon-Lyon University of Glasgow.
National Computational Science National Center for Supercomputing Applications National Computational Science NCSA-IPG Collaboration Projects Overview.
ILDG Middleware Status Chip Watson ILDG-6 Workshop May 12, 2005.
The Client/Server Database Environment Ployphan Sornsuwit KPRU Ref.
1 Welcome to CSC 301 Web Programming Charles Frank.
Java Portals and Portlets Submitted By: Rashi Chopra CIS 764 Fall 2007 Rashi Chopra.
Holding slide prior to starting show. A Portlet Interface for Computational Electromagnetics on the Grid Maria Lin and David Walker Cardiff University.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Getting started DIRAC Project. Outline  DIRAC information system  Documentation sources  DIRAC users and groups  Registration with DIRAC  Getting.
EGEE User Forum Data Management session Development of gLite Web Service Based Security Components for the ATLAS Metadata Interface Thomas Doherty GridPP.
DGC Paris WP2 Summary of Discussions and Plans Peter Z. Kunszt And the WP2 team.
ElVis – Collaborative Visualization Display and explore fusion data. Monitor TRANSP runs. Display input data. Retrieve shot data from MDSplus. Whiteboard.
Marcelo R.N. Mendes. What is FINCoS? A set of tools for data generation, load submission, and performance measurement of CEP systems; Main Characteristics:
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
Sponsored by the National Science Foundation 1 March 15, 2011 GENI I&M Update: I&M Service Types, Arrangements, Assembling Goals Architecture Overview.
Accounting in DataGrid HLR software demo Andrea Guarise Milano, September 11, 2001.
Holding slide prior to starting show. Lessons Learned from the GECEM Portal David Walker Cardiff University
Migrating Desktop Uniform Access to the Grid Marcin Płóciennik Poznan Supercomputing and Networking Center Poznan, Poland EGEE’07, Budapest, Oct.
VOX Project Status T. Levshina. 5/7/2003LCG SEC meetings2 Goals, team and collaborators Purpose: To facilitate the remote participation of US based physicists.
ECpE Student Database Team 21 Adviser: Tien Nguyen ECpE and Tony Moore.
Expense Tracking System Developed by: Ardhita Maharindra Muskan Regmi Nir Gurung Sudeep Karki Tikaprem Gurung Date: December 05 th, 2008.
Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.
1 (c) 2013 FabSoft. MOST Cloud Service What is a Cloud Service? A cloud service is internet-based, meaning that MOST is hosted on a server farm on the.
A System for Monitoring and Management of Computational Grids Warren Smith Computer Sciences Corporation NASA Ames Research Center.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
Web Portal Project.
Viet Tran Institute of Informatics Slovakia
Use of MyProxy for the FusionGrid
Reportnet 3.0 Database Feasibility Study – Approach
Presentation transcript:

SWIM WEB PORTAL by Dipti Aswath SWIM Meeting ORNL Oct 15-17, 2007

SWIM PORTAL DEPLOYED “FOR JAGUAR” WILL ADDRESS SEVERAL PROJECT ISSUES Don listed numerous high priority issues for the SWIM Project Need more users and more physics runs − Portal designed to lower barriers for launching SWIM physics runs − New users can include the experimental community We need to get everything ported to Jaguar − Jaguar “security issues” need to be resolved and a decision reached on the entire portal feasibility We SWIM specific publications − Does a publication that discusses the SWIM portal integrated with framework and running a physics code help here? We need monitoring and data retrieval tools − Monitoring and meta-data examination done within the portal We don’t yet have a system for handling the data we generate − Meta-data is handled by Obsidian, queries from the portal − Meta-data has data file location, no transfer mechanism at this point

Vision: Simulation Components Available to a Wider US Fusion Community via Web Clients The SWIM Web Portal is working towards realizing the vision − Prototype is operational Goals that will enable the vision to be fulfilled − SWIM Portal with web clients intended for convenience to physicists and not as a single required entry point − Browser Interface for easy data access and remote component submissions − Secure authenticated and authorized access for scientists to make and monitor component runs − Distributed authorization allow stakeholders easy control over resources

SWIM Federated Web Portal User Authentication XEventChannel Metadata (events) Data Manager Web Events Web Service mySQL Internal schema External schema Elvis Displays User delCred (single sign-ons) Framework AORSA TSC CQL3D M3D NIMROD Framework PPPL (/p/swim/portal) Remote Job Launch via Portal (portal_launch.py) swim_launch.py batch_mgt_ script.py fsp.sh Architecture : Web Portal Prototype Portal interaction with modules ROAM (AuthZ) Interaction between modules ROAM : Resource Oriented Authorization Manager

Prototype Operational Web Portal Services Services Provided: Secure authenticated and authorized accesses transparent to the user Platform to instantiate simulation runs remotely and monitor its run A meta-data manager to archive and retrieve meta-data information (as per user query) resulting from the runs. Meta-data is data about data (e.g. the file name of the data file, its location, and size, are all meta-data)

Prototype Portal Services (1) Security (transparent to the user) − Authentication : User signs on securely with FusionGrid credentials- an id and password, operated by ESnet − Authorization : Component service provider checks to see if authenticated user is authorized to access its service Component Submission and Monitoring − Platform to securely initialize and instantiate simulation runs on remote systems at PPPL (transpgrid.pppl.gov) − User ability to monitor the run launched remotely via events notifying the user on the status of the component run − Browser visualizations / displays of run results

Prototype Portal Services (2) Meta-Data Management − Automated generation and storage of metadata resulting from the runs to enable users to quickly retrieve information on runs made − Monitor run directories and store/extract information such as location, size, timestamp, owner as external meta-data and physics quantities of interest to users as internal meta-data − Relational schema (similar to D3D’s Code Run Database) uses: - Plasmas Table (contains an entry for every run made) - Aorsa_Details Table (handles internal meta-data for AORSA) - Codes Table (an entry for every simulation code) - File Object Table (handles external meta-data and contains information such as location, size, owner, type of the resulting run output files) - FSP_IUEvent Table (categorized sets of Events published for a run)

Prototype Status

We Propose the Following Next Steps Understand the security model required for Jaguar − Are FusionGrid credentials, certified by ESnet, acceptable? − Is MyProxy credential repository server acceptable? − Do all hosting servers (ROAM authorization, Obsidian data manager, Event manager, MyProxy, Pubcookie login, MySQL database, Apache Web Server) have to be located at ORNL? Meta-data enhancement − Enhance relational schema by adding physics quantities of interest − Have real code runs generate meta-data and archive via portal Deploy prototype data management system –Portal is one possible entry point Deploy production portal for SWIM physics runs on Jaguar

Project Decisions and Developer Input Required before Next Steps Commence Acceptable Jaguar security infrastructure must be specified Things needed from SWM physicists − A meta-data file that contains physics items that can be queried from within portal − Design decision on framework/portal integration scheme More feedback as components and services come online