Languages for Large Scale System Configuration John Hawkins Laboratory for the Foundations of Computer Science University of Edinburgh.

Slides:



Advertisements
Similar presentations
Large-Scale, Adaptive Fabric Configuration for Grid Computing Peter Toft HP Labs, Bristol June 2003 (v1.03) Localised for UK English.
Advertisements

LCFG overview and future Michael George University of Liverpool
1 OBJECTIVES To generate a web-based system enables to assemble model configurations. to submit these configurations on different.
2 We need programming languages to communicate with a computer. The two broad classifications of programming languages are: Low-level and High- level.
V.S. Subrahmanian University of Maryland 1 IMPACT: Future Directions (years 3 and 4)
The Structure of the GNAT Compiler. A target-independent Ada95 front-end for GCC Ada components C components SyntaxSemExpandgigiGCC AST Annotated AST.
Introduction & Overview CS4533 from Cooper & Torczon.
Basic Concepts The Unified Modeling Language (UML) SYSC System Analysis and Design.
Your Interactive Guide to the Digital World Discovering Computers 2012.
CONDOR DAGMan and Pegasus Selim Kalayci Florida International University 07/28/2009 Note: Slides are compiled from various TeraGrid Documentations.
MapReduce.
Chapter 16 The World Wide Web Chapter Goals Compare and contrast the Internet and the World Wide Web Describe general Web processing Describe several.
Chapter 2 The process Process, Methods, and Tools
COP4020 Programming Languages
Higher Grade Computing Studies 2. Languages and Environments Higher Computing Software Development S. McCrossan 1 Classification of Languages 1. Procedural.
Chapter 1. Introduction.
EDG LCFGng: concepts Fabric Management Tutorial - n° 2 LCFG (Local ConFiGuration system)  LCFG is originally developed by the.
October, Scientific Linux INFN/Trieste B.Gobbo – Compass R.Gomezel - T.Macorini - L.Strizzolo INFN - Trieste.
Division of IT Convergence Engineering Towards Unified Management A Common Approach for Telecommunication and Enterprise Usage Sung-Su Kim, Jae Yoon Chung,
1 The Map-Reduce Framework Compiled by Mark Silberstein, using slides from Dan Weld’s class at U. Washington, Yaniv Carmeli and some other.
RDFS Rapid Deployment Forecast System Visit at: Registration required.
1 Programming Languages Tevfik Koşar Lecture - II January 19 th, 2006.
Assessing the Suitability of UML for Modeling Software Architectures Nenad Medvidovic Computer Science Department University of Southern California Los.
1 History of compiler development 1953 IBM develops the 701 EDPM (Electronic Data Processing Machine), the first general purpose computer, built as a “defense.
Introduction to Hadoop and HDFS
1 3. Computing System Fundamentals 3.1 Language Translators.
Unit-1 Introduction Prepared by: Prof. Harish I Rathod
1.  10% Assignments/ class participation  10% Pop Quizzes  05% Attendance  25% Mid Term  50% Final Term 2.
ICS 321 Fall 2009 DBMS Application Programming Asst. Prof. Lipyeow Lim Information & Computer Science Department University of Hawaii at Manoa 10/06/20091Lipyeow.
Cloud Age Time to change the programming paradigm?
Installing, running, and maintaining large Linux Clusters at CERN Thorsten Kleinwort CERN-IT/FIO CHEP
Chapter 1 Introduction. Chapter 1 - Introduction 2 The Goal of Chapter 1 Introduce different forms of language translators Give a high level overview.
1. 2 Preface In the time since the 1986 edition of this book, the world of compiler design has changed significantly 3.
Programming Languages and Design Lecture 3 Semantic Specifications of Programming Languages Instructor: Li Ma Department of Computer Science Texas Southern.
Olof Bärring – WP4 summary- 4/9/ n° 1 Partner Logo WP4 report Plans for testbed 2 [Including slides prepared by Lex Holt.]
University of Bristol 5th GridPP Collaboration Meeting 16/17 September, 2002Owen Maroney University of Bristol 1 Testbed Site –EDG 1.2 –LCFG GridPP Replica.
Chapter 5: Software Re-Engineering Omar Meqdadi SE 3860 Lecture 5 Department of Computer Science and Software Engineering University of Wisconsin-Platteville.
 Programming - the process of creating computer programs.
IT System Administration Lesson 3 Dr Jeffrey A Robinson.
Maite Barroso - 10/05/01 - n° 1 WP4 PM9 Deliverable Presentation: Interim Installation System Configuration Management Prototype
A Portrait of the Semantic Web in Action Jeff Heflin and James Hendler IEEE Intelligent Systems December 6, 2010 Hyewon Lim.
Integrating Big Data into the Computing Curricula 02/2015 Achmad Benny Mutiara
What is a compiler? –A program that reads a program written in one language (source language) and translates it into an equivalent program in another language.
David Foster LCG Project 12-March-02 Fabric Automation The Challenge of LHC Scale Fabrics LHC Computing Grid Workshop David Foster 12 th March 2002.
ATLAS-specific functionality in Ganga - Requirements for distributed analysis - ATLAS considerations - DIAL submission from Ganga - Graphical interfaces.
15-Feb-02Steve Traylen, RAL WP6 Test Bed Report1 RAL/UK WP6 Test Bed Report Steve Traylen, WP6 PPGRID/RAL, UK
Alexey Badalov Contents Gaudi — LHCb’s software framework GPU Manager CUDA development with Gaudi Testing
1 Asstt. Prof Navjot Kaur Computer Dept PRESENTED BY.
Component 4: Introduction to Information and Computer Science Unit 9/Part e: Components and Development of Large Scale Systems.
LECTURE 3 Translation. PROCESS MEMORY There are four general areas of memory in a process. The text area contains the instructions for the application.
 Project Team: Suzana Vaserman David Fleish Moran Zafir Tzvika Stein  Academic adviser: Dr. Mayer Goldberg  Technical adviser: Mr. Guy Wiener.
Programming Languages Concepts Chapter 1: Programming Languages Concepts Lecture # 4.
Parag Mhashilkar (Fermi National Accelerator Laboratory)
Software Release Build Process and Components in ATLAS Offline Emil Obreshkov for the ATLAS collaboration.
1 Policy Based Systems Management with Puppet Sean Dague
Lecture 3 Translation.
Tool Support for Testing
Applications Active Web Documents Active Web Documents.
Deployment of Flows Loretta Auvil
Context-Sensitive Analysis
Principles of programming languages 8: Types
Database Management:.
History of compiler development
Ministry of Higher Education
Compiler Construction
Database System Architecture
Database Environment Transparencies
CS639: Data Management for Data Science
Towards Unified Management
Scientific Workflows Lecture 15
Presentation transcript:

Languages for Large Scale System Configuration John Hawkins Laboratory for the Foundations of Computer Science University of Edinburgh

System Configuration Need to configure large groups of machines Traditionally done using scripts or disk imaging Tools such as Cfengine useful but problematic Move towards use of declarative languages for specification of configuration Current declarative languages still have drawbacks

LCFG Developed by Paul Anderson, University of Edinburgh 1994 Central configuration repository Configurations compiled from ‘header files’ into profile Profiles shipped to hosts Hosts run set of ‘components’ which manage configuration Language relatively basic Use of C Preprocessor for file inclusion and override macros Data represented as key-value pairs

Requirements for Future Languages Increased scalability (over 1000 nodes) Removal of dependence on central server Looser specification, particularly with use of constraints Improved support for devolved management teams Reduced ambiguity in source syntax Better understood language semantics Improved support for dynamic reconfiguration, to cope with rapidly changing requirements and failure recovery Increased ease of adoption

A Language Based on Partially Ordered Maps Propose to base language around unified data structure Pomap – pair consisting of set of tag, value pairs and set of constraints Tag can map to a value, or another pomap Basic types – scalars, records, partially ordered sets User defined types may be added Three phases to compilation –Translation of source to pomap representation –Composition of pomap fragments –Evaluation to produce final values Currently working on static configuration problem, but will extend to dynamic configuration

Grid Configuration Important to ensure correct low-level configuration of nodes Dynamic reconfiguration of nodes to meet specific requirements of individual jobs For example, job depends on particular version of gcc Higher-level configuration tasks, eg configuring web/Grid services Some work at Edinburgh on Grid configuration