Managing Enterprise Directories: Operational Issues Performance Monitoring Brendan Bellina, University of Notre Dame Base CAMP – Tempe, Arizona February.

Slides:



Advertisements
Similar presentations
Web Performance Tuning Lin Wang, Ph.D. US Department of Education Copyright [Lin Wang] [2004]. This work is the intellectual property of the author. Permission.
Advertisements

What Does the Net Generation Expect From Us? SAC August 8, 2005 SAC August 8, 2005 Copyright © 2005, Joel L. Hartman. This work is the intellectual property.
Cut Costs and Increase Productivity in your IT Organization with Effective Computer and Network Monitoring. Copyright © T3 Software Builders, Inc 2004.
LDAP-Enabled Privacy at The University of Notre Dame EduCAUSE conference, October 2002 Brendan Bellina Office of Information Technologies University of.
LiveHelp over the web: a Local Collaborative Approach Rachel Cheng University Librarian Eastern Michigan University Steve Bischof Resource Assessment &
Copyright Sylvia Maxwell and Michael White, This work is the intellectual property of the author. Permission is granted for this material to be shared.
Architecting Your Data and Metadirectory Model Brendan Bellina, University of Notre Dame Base CAMP - Tempe, Arizona February 5-7, 2003 Copyright Brendan.
University of Central Florida’s ePay System: Online, Not In Line CUMREC 2004 May 16th – 19th Aaron Streimish Special Projects Coordinator Computer Services.
Migrating to uPortal 2 at UBC Paul Zablosky University of British Columbia Copyright Paul Zablosky This work is the intellectual property of the.
Method: systematically gather citations by KU faculty and approach those faculty for permission to deposit on their behalf articles published in journals.
JA-SIG CAS Enterprise Single Sign-On Scott Battaglia Application Developer Enterprise Systems & Services Rutgers, the State University of New Jersey Copyright.
Identity Management: The Legacy and Real Solutions Project Overview.
The Journey Toward 24/7 IT Monitoring University of North Carolina at Greensboro Design and Build of Network Operations Center Copyright Thomas M. Sheriff,
Procurement From the 20 th to the 21 st Century Copyright Byron Honoré This work is the intellectual property of the author. Permission is granted.
Copyright Anthony K. Holden, This work is the intellectual property of the author. Permission is granted for this material to be shared for non-commercial,
Web Portal Development with uPortal or.Net Midwest Educause: March 24-26, 2003 David B. Williams Mark Troester
1 EDUCAUSE 2002 IT Support Community Training Model University of Colorado at Boulder.
F Fermilab Database Experience in Run II Fermilab Run II Database Requirements Online databases are maintained at each experiment and are critical for.
Western Illinois University - Electronic Student Services Copyright Statement Copyright Western Illinois University – Electronic Student Services 2001.
Mobile Computing and Security Authenticated Network Access (ANA) Jon Peters Associate Director Dave Packham Manager of Network Engineering NetCom University.
Moving Your Paperwork Online Western Washington University E-Sign Web Forms Copyright Western Washington University, This work is the intellectual.
Why We Need It In a Small Residential College The Plan The Reality What We Hope to Accomplish What We Have Learned So Far Unexpected Benefits Statistics.
Multimedia Modules Teaching and Learning Multimedia Applications with Written Scripts John Bowers, Director of Computing Services Pam Gades, Instructional.
Presenter: Tyson Seburn Copyright ENGLISH CENTRAL, This work is the intellectual property of the author. Permission is granted for this material.
Learning Management Systems Camp June 2004 Barry R Ribbeck UT HSC Houston Copyright, Barry Ribbeck, This work is the intellectual property of the.
Steven Hazzard – Dir Application Systems Karin West Mormando – Assoc Dir Admissions Charles Musgrove – Assoc Dir Admissions Extreme Makeover: Rebuilding.
Invent the Future. Some information about VT ~28,000 students; 83% UG/17% Graduate Most users publish/utilize a single address such as
Identity Management – Why and How Experiences at CU-Boulder Copyright Linda Drake, Director of Development and Integration, University of Colorado, Boulder,
Baylor University and Xythos EduCause Southwest 2007 Dr. Sandra Bennett Program Manager Online Teaching and Learning System Copyright Sandra Bennett 2007.
Copyright Louisiana State University This work is the intellectual property of the author. Permission is granted for this material to be shared for.
1 No More Paper, No More Stamps: Targeted myWSU Communications Lavon R. Frazier April 27, 2005 Copyright Lavon R. Frazier, This work is the intellectual.
Sharing Information and Controlling Content: Continuing Challenges for Higher Education Susanna Frederick Fischer Assistant Professor Columbus School of.
1 Network Statistic and Monitoring System Wayne State University Division of Computing and Information Technology Information Technology.
Copyright Michael White and Sandra Thompson, This work is the intellectual property of the author. Permission is granted for this material to be.
Issues Associated with ePortfolios in Small Colleges EDUCAUSE Mid-Atlantic Regional Conference 2006 Ed Barboni, Senior Advisor, Council of Independent.
© 2008 Ocean Data Systems Ltd - Do not reproduce without permission - exakom.com creation Dream Report O CEAN D ATA S YSTEMS O CEAN D ATA S YSTEMS The.
workshop eugene, oregon What is network management? System & Service monitoring  Reachability, availability Resource measurement/monitoring.
Grids USC Case Study Copyright Shelley Henderson This work is the intellectual property of the author. Permission is granted for this material to.
© 2006 Property of Lancope. Proprietary and Confidential. Lancope and Emory University: Illuminating (and Securing) the Network Andy Wilson Senior Systems.
ONLINE TESL RESOURCES ©Copyright Rachel Fourny 2010.
3 Nov 2003 A. Vandenberg © Second NMI Integration Testbed Workshop on Experiences in Middleware Deployment, Anaheim, CA 1 NMI R3 Enterprise Directory Components.
LDAP: Accessing Operational Information CNS 4650 Fall 2004 Rev. 2.
Copyright David A. Cox This work is the intellectual property of the author. Permission is granted for this material to be shared for non- commercial,
Improving the Social Nature of OnLine Learning Tap into what students are already doing Tap into what students are already doing Educause SWRC07 Copyright.
A Cat-Herding Tale Forging a Single Course Management System for a Decentralized Institution Copyright Abdul Shibli, 2004.This work is the intellectual.
1 Effective Incident Response Presented by Greg Hedrick, Manager of Security Services Copyright Purdue University This work is the intellectual property.
October 2001MyDatabase1 MyDatabase A framework for creating desktop media collections Caroline Beebe North Carolina State University Indiana University.
Copyright © 2011 Rachel Fourny. This work is the intellectual property of Rachel Fourny. Permission is granted for this material to be shared for non-commercial,
Distributed Logging Facility Castor External Operation Workshop, CERN, November 14th 2006 Dennis Waldron CERN / IT.
Directory Service Operational Issues Transaction Performance Monitoring at the University of Notre Dame Brendan Bellina, University of Notre Dame.
Quickly Establishing A Workable IT Security Program EDUCAUSE Mid-Atlantic Regional Conference January 10-12, 2006 Copyright Robert E. Neale This.
Mining User Data: Getting the Most out of your CMS John Fritz, UMBC.
Recent Developments in Directories: Performance Monitoring with “Look” Brendan Bellina, University of Notre Dame Spring 2003 Internet2 Member Meeting.
WebISO, Single Sign-On & Authorization General Overview Shelley Henderson Project Manager, Grid Software USC Information Services Copyright.
Copyright James Kulich This work is the intellectual property of the author. Permission is granted for this material to be shared for non-commercial,
Copyright Michael White and Sylvia Maxwell, This work is the intellectual property of the author. Permission is granted for this material to be shared.
© Scottsdale Community College Leveraging the Power of E-Learning Taking your course to a higher level Presented by Sidne Tate Director, Instructional.
University of Southern California Identity and Access Management (IAM)
Proactive Systems Monitoring
Julian Hooker Assistant Managing Director Educause Southwest
Federating with NIH, NSF, and the National Student Clearinghouse
Implementation and configuration of LDAP
Copyright Notice Copyright Bob Bailey This work is the intellectual property of the author. Permission is granted for this material to be shared.
Ed Barboni, Senior Advisor, Council of Independent Colleges
Blaine A. Brownell, President,
University of Southern California Identity and Access Management (IAM)
Project for OnLine Instructional Support (POLIS)
myIS.neu.edu – presentation screen shots accompany:
An App A Day Copyright Tina Oestreich and Brian Yuhnke This work is the intellectual property of the author. Permission is granted for this material.
Bad News Messages: How Much and How Often?
Presentation transcript:

Managing Enterprise Directories: Operational Issues Performance Monitoring Brendan Bellina, University of Notre Dame Base CAMP – Tempe, Arizona February 5-7, 2003 Copyright Brendan Bellina, This work is the intellectual property of the author. Permission is granted for this material to be shared for non-commercial, educational purposes, provided that this copyright statement appears on the reproduced materials and notice is given that the copying is by permission of the author. To disseminate otherwise or to republish requires written permission from the author.

Base CAMP - February 5-7, 2003Middleware: Directories 2 How to present in 33 minutes (or less!) No humor No arbitrary anecdotes No incoherent rambling … but how will we know it is a middleware presentation? That is why there is a page footer. One more thing… Volunteer alarm clock

Base CAMP - February 5-7, 2003Middleware: Directories 3 Presentation Overview Why Monitor Performance What Performance Metrics To Monitor How To Gather Performance Metrics Tools for Performance ND –Orca –Orcallator –Look

Base CAMP - February 5-7, 2003Middleware: Directories 4 Why Monitor Performance Availability It’s up… isn’t it? –Directories often require 7x24 availability Responsiveness It’s fast enough… maybe. –Directories often require extremely fast response Scalability We can handle that… I think. –Structural changes, indices, increases in the # of entries or # of attributes can all affect performance.

Base CAMP - February 5-7, 2003Middleware: Directories 5 What Performance Metrics To Monitor Response time Connection requests Bind requests Bind errors Search requests Search errors Average count & size of search results Directory Cache Hits Directory Cache Tries Bind response time Search response time Current connections Avg connection length Current binds Current searches # Bytes transmitted # Entries transmitted

Base CAMP - February 5-7, 2003Middleware: Directories 6 How To Gather Performance Metrics Directory internal query (iPlanet, OpenLDAP) base search on cn=monitor ldapsearch -h directory.whatsamattau.edu -b"cn=monitor" -s base objectclass=* objectclass=top objectclass=extensibleObject cn=monitor version=Netscape-Directory/4.16 B threads=30 currentconnections=27 totalconnections= dtablesize=1024 readwaiters=0

Base CAMP - February 5-7, 2003Middleware: Directories 7 How To Gather Performance Metrics base search on cn=monitor cont. opsinitiated= opscompleted= entriessent= bytessent= currenttime= Z starttime= Z nbackends=1 dataversion=directory.whatsamattau.edu: ldapserverconfigdn=cn=ldap://:389,dc=directory,dc=whatsamattau,dc=edu backendmonitordn=cn=monitor,cn=ldbm

Base CAMP - February 5-7, 2003Middleware: Directories 8 How To Gather Performance Metrics base search on cn=monitor, cn=ldbm ldapsearch -h directory.whatsamattau.edu -b"cn=monitor,cn=ldbm" -s base objectclass=* objectclass=top objectclass=extensibleObject cn=monitor database=ldbm readonly=0 entrycachehits= entrycachetries= entrycachehitratio=93 currententrycachesize=10000 maxentrycachesize=10000 dbchehits= dbcachetries= dbcachehitratio=96 dbcachepagein=32268 dbcachepageout=851 dbcacheroevict=20160 dbcacherwevict=0 dbfilename-0=wuAttribute_1.db2 dbfilecachehit-0=26 dbfilecachemiss-0=4 dbfilepagein-0=4 dbfilepageout-0=4

Base CAMP - February 5-7, 2003Middleware: Directories 9 How To Gather Performance Metrics LDAP log processing –Read the log files looking for events –Calculate statistics Directory Probing –Ping –Query to directory service –Bind to directory service –SNMP

Base CAMP - February 5-7, 2003Middleware: Directories 10 How To Monitor Performance Metrics NMS (Network Management System) –HP OpenView –CA/UniCenter TNG –IBM NetView Operating System Tools –Win NT Event Viewer –W2K WMI (Windows Management Instrumentation) –W2K Network Monitor; W2K System Monitor –Sun Solaris SE Toolkit

Base CAMP - February 5-7, 2003Middleware: Directories 11 Tools for Performance ND Orca - Orcallator (collector for Solaris statistics) Look – LDAP operational Orca “k”ollector

Base CAMP - February 5-7, 2003Middleware: Directories 12 Orca ( About Orca: Generates web friendly performance graphs based on collected statistical data. Free (will take donations) Open Source Perl Used by Yahoo!/Geocities Used at Notre Dame on 100+ servers Hourly, Daily, Weekly, Monthly, Quarterly, Yearly, All Did I say free?

Base CAMP - February 5-7, 2003Middleware: Directories 13 Notre Dame CRON job runs every 15 minutes to regen graphs Orcallator (SymbEL script included with ORCA) –Written to monitor web servers and Solaris stats –Requires Sun Solaris SE Toolkit (free from –Runs on each directory server to collect statistics – 5 minute averages, 30 second peaks –Data is consolidated on one server for ORCA processing –Modifications by ND to read iPlanet Dir Server 4.16 log

Base CAMP - February 5-7, 2003Middleware: Directories 14 Notre Dame ND Modifications -LDAP connection rate -LDAP Bind rate -LDAP Bind error rate -LDAP search rate -LDAP search error rate -LDAP search results returned rate -Picture is worth 1000 words: -Go to

Base CAMP - February 5-7, 2003Middleware: Directories 15 Look – LDAP operational Orca "k"ollector LDAP supplement to Orca and/or Orcallator Perl script Produces Orca compatible output files Processes iPlanet 4.16 log file Queries directory cn=monitor Queries directory cn=monitor, cn=ldbm Beta 0.90 version currently available at

Base CAMP - February 5-7, 2003Middleware: Directories 16 Look – LDAP operational Orca "k"ollector Connection Rate Bind Rate Bind Error Rate Search Rate Search Error Rate Search Results Returned Rate Connections Operations Initiated Operations Completed Entries Sent Bytes Sent Entry Cache Hits Entry Cache Tries Cache Hit Ratio Database Cache Hits Database Cache Tries Database Cache Hit Ratio Peaks and Averages View live results at

Base CAMP - February 5-7, 2003Middleware: Directories 17 ORCA Look Graph Example #1 LDAP search rate before and after routing was transferred from -specific directory to EDS:

Base CAMP - February 5-7, 2003Middleware: Directories 18 ORCA Look Graph Example #2: Troubleshooting Daily abuse of open LDAP connections. What is different about the weekend?

Base CAMP - February 5-7, 2003Middleware: Directories 19 ORCA Look Graph Example #3: Troubleshooting How long has this been going on? Week 49. What happened in mid-December? Hmmm…

Base CAMP - February 5-7, 2003Middleware: Directories 20 ORCA Look Graph Example #4: Troubleshooting The culprit has been identified and shot.

Base CAMP - February 5-7, 2003Middleware: Directories 21 ORCA Look Graph Example #5: Troubleshooting The sky is blue, the birds are chirping, and all is right with the world.

Base CAMP - February 5-7, 2003Middleware: Directories 22 Links Notre Dame Enterprise Directory Service Notre Dame EDS Performance Statistics - Orcallator or Notre Dame EDS Performance Statistics – Look or ORCA software Look software Brendan Bellina

Base CAMP - February 5-7, 2003Middleware: Directories 23 Copyright Statement Copyright © Brendan Bellina, This work is the intellectual property of the author. Permission is granted for this material to be shared for non-commercial, educational purposes, provided that this copyright statement appears on the reproduced materials and notice is given that the copying is by permission of the author. To disseminate otherwise or to republish requires written permission from the author.