Derek Weitzel Grid Computing. Background B.S. Computer Engineering from University of Nebraska – Lincoln (UNL) 3 years administering supercomputers at.

Slides:



Advertisements
Similar presentations
A Workflow Engine with Multi-Level Parallelism Supports Qifeng Huang and Yan Huang School of Computer Science Cardiff University
Advertisements

1 G2 and ActiveSheets Paul Roe QUT Yes Australia!
R and HDInsight in Microsoft Azure
A Hadoop Overview. Outline Progress Report MapReduce Programming Hadoop Cluster Overview HBase Overview Q & A.
Building Campus HTC Sharing Infrastructures Derek Weitzel University of Nebraska – Lincoln (Open Science Grid Hat)
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
AStudy on the Viability of Hadoop Usage on the Umfort Cluster for the Processing and Storage of CReSIS Polar Data Mentor: Je’aime Powell, Dr. Mohammad.
Distributed Application Management Using PLuSH Jeannie Albrecht, Christopher Tuttle, Alex C. Snoeren, and Amin Vahdat UC San Diego CSE {jalbrecht, ctuttle,
1 CIS450/IMSE450/ECE478 Operating Systems Winter 2003 Professor Jinhua Guo.
The Open Grid Service Architecture (OGSA) Standard for Grid Computing Prepared by: Haoliang Robin Yu.
To run the program: To run the program: You need the OS: You need the OS:
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES News on monitoring for CMS distributed computing operations Andrea.
Data Mining on the Web via Cloud Computing COMS E6125 Web Enhanced Information Management Presented By Hemanth Murthy.
Cloud Computing for the Enterprise November 18th, This work is licensed under a Creative Commons.
Committed to Deliver….  We are Leaders in Hadoop Ecosystem.  We support, maintain, monitor and provide services over Hadoop whether you run apache Hadoop,
© Spinnaker Labs, Inc. Google Cluster Computing Faculty Training Workshop Open Source Tools for Teaching.
Cloud Computing 1. Outline  Introduction  Evolution  Cloud architecture  Map reduce operation  Platform 2.
Tools and Utilities for parallel and serial codes in ENEA-GRID environment CRESCO Project: Salvatore Raia SubProject I.2 C.R. ENEA-Portici. 11/12/2007.
Test Of Distributed Data Quality Monitoring Of CMS Tracker Dataset H->ZZ->2e2mu with PileUp - 10,000 events ( ~ 50,000 hits for events) The monitoring.
PCGRID ‘08 Workshop, Miami, FL April 18, 2008 Preston Smith Implementing an Industrial-Strength Academic Cyberinfrastructure at Purdue University.
Submitted by: Shailendra Kumar Sharma 06EYTCS049.
Rocks ‘n’ Rolls An Introduction to Programming Clusters using Rocks © 2008 UC Regents Anoop Rajendra.
EXPOSE GOOGLE APP ENGINE AS TASKTRACKER NODES AND DATA NODES.
Hadoop Basics -Venkat Cherukupalli. What is Hadoop? Open Source Distributed processing Large data sets across clusters Commodity, shared-nothing servers.
Introduction to Apache Hadoop Zibo Wang. Introduction  What is Apache Hadoop?  Apache Hadoop is a software framework which provides open source libraries.
Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.
Grid Resource Allocation and Management (GRAM) Execution management Execution management –Deployment, scheduling and monitoring Community Scheduler Framework.
CSE 548 Advanced Computer Network Security Document Search in MobiCloud using Hadoop Framework Sayan Cole Jaya Chakladar Group No: 1.
:: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :: GridKA School 2009 MPI on Grids 1 MPI On Grids September 3 rd, GridKA School 2009.
Hadoop Ali Sharza Khan High Performance Computing 1.
Batch Scheduling at LeSC with Sun Grid Engine David McBride Systems Programmer London e-Science Centre Department of Computing, Imperial College.
Software Scalability Issues in Large Clusters CHEP2003 – San Diego March 24-28, 2003 A. Chan, R. Hogue, C. Hollowell, O. Rind, T. Throwe, T. Wlodek RHIC.
Resource Brokering in the PROGRESS Project Juliusz Pukacki Grid Resource Management Workshop, October 2003.
SALSASALSASALSASALSA FutureGrid Venus-C June Geoffrey Fox
 Apache Airavata Architecture Overview Shameera Rathnayaka Graduate Assistant Science Gateways Group Indiana University 07/27/2015.
A Web Laboratory for Visual Interactive Simulation of Epitaxial Growth Feng Liu University of Utah Recently, we have developed a prototype of web laboratory.
Real-time Scheduling for Grid Computing Anwar Mamat.
NA-MIC National Alliance for Medical Image Computing Core 1b – Engineering Computational Platform Jim Miller GE Research.
Tier3 monitoring. Initial issues. Danila Oleynik. Artem Petrosyan. JINR.
Distributed Real-time Systems- Lecture 01 Cluster Computing Dr. Amitava Gupta Faculty of Informatics & Electrical Engineering University of Rostock, Germany.
3/12/2013Computer Engg, IIT(BHU)1 CLOUD COMPUTING-2.
Intermediate Parallel Programming and Cluster Computing Workshop Oklahoma University, August 2010 Running, Using, and Maintaining a Cluster From a software.
INRNE's participation in LCG Elena Puncheva Preslav Konstantinov IT Department.
Background Computer System Architectures Computer System Software.
Next Generation of Apache Hadoop MapReduce Owen
INTRODUCTION TO HADOOP. OUTLINE  What is Hadoop  The core of Hadoop  Structure of Hadoop Distributed File System  Structure of MapReduce Framework.
Dato Confidential 1 Danny Bickson Co-Founder. Dato Confidential 2 Successful apps in 2015 must be intelligent Machine learning key to next-gen apps Recommenders.
What is it and why it matters? Hadoop. What Is Hadoop? Hadoop is an open-source software framework for storing data and running applications on clusters.
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT Our experience with NoSQL and MapReduce technologies Fabio Souto.
CNAF - 24 September 2004 EGEE SA-1 SPACI Activity Italo Epicoco.
Leverage Big Data With Hadoop Analytics Presentation by Ravi Namboori Visit
Hadoop Javad Azimi May What is Hadoop? Software platform that lets one easily write and run applications that process vast amounts of data. It includes:
Connected Infrastructure
Big Data is a Big Deal!.
Hadoop Aakash Kag What Why How 1.
Big Data A Quick Review on Analytical Tools
The Open Grid Service Architecture (OGSA) Standard for Grid Computing
Connected Infrastructure
CRESCO Project: Salvatore Raia
Distributed System Concepts and Architectures
Meng Cao, Xiangqing Sun, Ziyue Chen May 28th, 2014
Distributed Systems CS
Development of the Nanoconfinement Science Gateway
Verilog to Routing CAD Tool Optimization
SDM workshop Strawman report History and Progress and Goal.
Introduction to Apache
Execution Framework: Hadoop 2.x
Lecture 16 (Intro to MapReduce and Hadoop)
Distributed Systems CS
German Astrophysical Virtual Observatory
Presentation transcript:

Derek Weitzel Grid Computing

Background B.S. Computer Engineering from University of Nebraska – Lincoln (UNL) 3 years administering supercomputers at UNL Built, maintained, and developed 3 tiled display walls. Interests: Distributed Computing (Hadoop, ~MPI…) Data Visualization ( Cluster/Supercomputer Administration Computer Architecture

Interest In Grids CMS Tier-2 hosted at UNL (Red) Grid Storage (SE) Parallel algorithms deployed on the grid Real-Time interactive visualizations

Research Directions Hadoop on the Grid Hadoop: Used as Storage and a Distributed Processing Framework Data Visualization Fish: Cluster monitoring tool using ganglia Hadoop Visualization: Distributed file system real-time visualization.

Future Grid Plans Hadoop on the grid Running a parallel map-reduce job on a grid machine Install and Maintain a CE on a local cluster to utilize idle cycles Assist local researchers to adapt their code to the grid environment

Feedback: Privacy Policy Feedback
Do Not Sell My Personal Information
About project: SlidePlayer Terms of Service

© 2024 SlidePlayer.com Inc. All rights reserved.