SAN DIEGO SUPERCOMPUTER CENTER Inca Data Display (data consumers) Shava Smallen Inca Workshop September 5, 2008

Grid Resource … Reporter Manager Reporter Repository Agent Depot R S Data Consumers Grid Resource Reporter Manager R S R C Incat r r S Data Consumers Anything that queries and digests data from the depot Inca distribution includes a container and webapp to provide Web view of Inca deployment Designed for grid operators, system administrators, and users

SAN DIEGO SUPERCOMPUTER CENTER JSP Current and historical views Web application packaged with Jetty JSP 2.0 pages/tags to query data and format using XSLT CeWolf/JFreeChart to graph data Consumer displays data JSP XML XSL Depot query results (XML) query Graphs charts HTML Consumer

SAN DIEGO SUPERCOMPUTER CENTER Files for customization Config files for views Config authentication Config colors Inca webapp runs inside Jetty 6 container

Inca’s status pages provide multiple levels of details Series Summary Series Details Current statusHistorical Individual series history Related series histories Error history summary Weekly status report Cumulative series status by resource Series status by package and resource Individual report details Suite & resource histories

Inca’s status pages provide multiple levels of details Series Summary Series Details Current statusHistorical Individual series history Related series histories Error history summary Weekly status report Cumulative series status by resource Series status by package and resource Individual report details Suite & resource histories

SAN DIEGO SUPERCOMPUTER CENTER status.jsp View cumulative series status by resource google.xml google.xsl Depot query results (XML) query Consumer HTML Register for a Google Map API key Specify size of map, center of map, zoom level Define sites -- logo and resources Optionally change icons or colors

SAN DIEGO SUPERCOMPUTER CENTER Google map view configured via XML ABQIAAAA_4IHDoSvxQqISMa1RKFLQBSAw7Yim1cIRTlscO SDSC … ia64 … … Size of map Center of map -- default is middle of US Site name and location List of resources

SAN DIEGO SUPERCOMPUTER CENTER Specify a logo for a site c_black.gif

Inca’s status pages provide multiple levels of details Series Summary Series Details Current statusHistorical Individual series history Related series histories Error history summary Weekly status report Cumulative series status by resource Series status by package and resource Individual report details Average suite & resource series pass rate history

SAN DIEGO SUPERCOMPUTER CENTER status.jsp View series status by package and resource default.xsl Depot query results (XML) query Consumer HTML Specify list of suite(s) and resource(s) in URL ? suiteNames=s1[,s2,…] resourceIds=r1[,r2,…]

SAN DIEGO SUPERCOMPUTER CENTER status.jsp View report status by package and resource (categories) swStack.xsl Depot query results (XML) query Consumer HTML Specify list of suite(s), resource(s), xml(s) in URL ? xsl=swStack.xsl suiteNames=s1[,s2, …] resourceIds=r1[,r2, …] xml=x1[,x2, …] swStack.xml

SAN DIEGO SUPERCOMPUTER CENTER Software categories listed in XML file Software and Services Cluster Tools gcc any gcc_version gcc_hello_world …

Inca’s status pages provide multiple levels of details Series Summary Series Details Current statusHistorical Individual series history Related series histories Error history summary Weekly status report Cumulative series status by resource Series status by package and resource Individual report details Suite & resource histories

SAN DIEGO SUPERCOMPUTER CENTER instance.jsp View individual report details instance.xsl Depot query results (XML) query Consumer HTML Linked from other views Specify series config id, instance id, and resource id ? configId=1234 & instanceId=456 & resourceId=r

Inca’s status pages provide multiple levels of details Series Summary Series Details Current statusHistorical Individual series history Related series histories Error history summary Weekly status report Cumulative series status by resource Series status by package and resource Individual report details Suite & resource histories

SAN DIEGO SUPERCOMPUTER CENTER graph.jsp Linked from individual report details page Requires series nickname, resource, and title Two weeks of history by default Options: Mouseovers and links Legend ( and position) Width, Height Background color View individual series history Depot query results (XML) query Graphs charts HTML Consumer

SAN DIEGO SUPERCOMPUTER CENTER Choose selected series histories Is an error related to the resource or the software? What is the reliability of a service (viewing multiple tests)?

Inca’s status pages provide multiple levels of details Series Summary Series Details Current statusHistorical Individual series history Related series histories Error history summary Weekly status report Cumulative series status by resource Series status by package and resource Individual report details Suite & resource histories

SAN DIEGO SUPERCOMPUTER CENTER graph.jsp Requires multiple series nickname, resource, and title Two weeks of history by default Options: Mouseovers and links Legend ( and position) Width, Height Background color View related series histories Depot query results (XML) query Graphs charts HTML Consumer

SAN DIEGO SUPERCOMPUTER CENTER report.jsp Requires multiple series nickname, resource, and titles described in XML file Two weeks of history by default Options: Mouseovers and links Legend ( and position) Width, Height Background color View related series histories as report Depot query results (XML) query Graphs charts HTML Consumer status Report.xml

SAN DIEGO SUPERCOMPUTER CENTER Graphs and series described in XML file ant_version,localResource,ant version gcc_version,localResource,gcc version java_version,localResource,java version openssh_version,localResource,openssh version openssl_version,localResource,openssl version vtk-nvgl_version,localResource,vtk version Software Deployment Tests … 350

Inca’s status pages provide multiple levels of details Series Summary Series Details Current statusHistorical Individual series history Related series histories Error history summary Weekly status report Cumulative series status by resource Series status by package and resource Individual report details Suite & resource histories

SAN DIEGO SUPERCOMPUTER CENTER status.jsp Designed for daily/weekly review Uses cached historical query Four weeks of history by default Sortable by column View error history summary ( “diff” ) Depot query results (XML) query Graphs charts HTML Consumer week Summary.xml

Inca’s status pages provide multiple levels of details Series Summary Series Details Current statusHistorical Individual series history Related series histories Error history summary Weekly status report Cumulative series status by resource Series status by package and resource Individual report details Suite & resource histories

SAN DIEGO SUPERCOMPUTER CENTER summary History.jsp Designed for daily/weekly review Uses cached historical query Four weeks of history by default Click to view further details View average suite and resource histories Depot query results (XML) query Graphs charts HTML Consumer

SAN DIEGO SUPERCOMPUTER CENTER View suite or resource history details Suite status for each resource Status of suite on all resources

Inca’s status pages provide multiple levels of details Series Summary Series Details Current statusHistorical Individual series history Related series histories Error history summary Weekly status report Cumulative series status by resource Series status by package and resource Individual report details Suite & resource histories

SAN DIEGO SUPERCOMPUTER CENTER summary.jsp Designed for daily/weekly review Uses cached historical query Four weeks of history by default Click to view further details View weekly suite and resource status Depot query results (XML) query Graphs charts HTML Consumer

SAN DIEGO SUPERCOMPUTER CENTER View suite and resource details Suite status for each resource

SAN DIEGO SUPERCOMPUTER CENTER Caching provides quick page load times Periodically load and store large queries Latest suite instances cached by default -- frequency from reload property Query management page allows view, execute, refresh, and modification action on queries (requires authentication) Query management page

SAN DIEGO SUPERCOMPUTER CENTER Daily history query analyzes errors PERIOD, DAYS, CONDITION where PERIOD = DAY | WEEK | MONTH | QUARTER Four weeks of history loaded every day -- time of day from reloadAt property TeraGrid - 10 weeks of history (WEEK, 70, 1 = 1) Query management page

SAN DIEGO SUPERCOMPUTER CENTER Daily history query output incas://rocks-101.sdsc.edu:6323/sampleSuite gcc_hello_world localResource gcc: Command not found … suite series period 1 num successes failure

SAN DIEGO SUPERCOMPUTER CENTER Create a custom query View subset of series in a suite View series in multiple suites Requires authentication and suiteNames

SAN DIEGO SUPERCOMPUTER CENTER Use custom query name in views Use queryNames in place of suiteNames ? queryNames=myquery resourceIds=defaultGrid

SAN DIEGO SUPERCOMPUTER CENTER Password authentication can be customized Ports: HTTP on 8080, HTTPS on 8443 Password protection on query.jsp and status-auth.jsp (change in $INCA_DIST/webapps/inca/WEB-INF/web.xml ) Password set in $INCA_DIST/etc/realm.properties username: password

SAN DIEGO SUPERCOMPUTER CENTER Customize the header Add logo or background color here Header can be customized by editing unordered list in header.xsl -- change for your suites Add logo at top or background color by adding row to table

SAN DIEGO SUPERCOMPUTER CENTER … … Current Data Table View All Tests Common Tests … Add GEON logo to top of page

SAN DIEGO SUPERCOMPUTER CENTER Changing colors in CSS Edit CSS (Cascading Style Sheet) to change colors and fonts E.g. change.header background- color $INCA_INSTALL/webapps/css/inca.css.header { background-color: #D07651;

SAN DIEGO SUPERCOMPUTER CENTER Summary A data consumer is anything that queries and digests data from the depot Inca includes a data consumer -- an embedded Jetty web container that includes a webapp Inca’s status pages provide multiple levels of details from historical to current data and summary and detail views Caching of queries is automated to optimize page load times and can be customized Status pages’ content, look, and security can be customized

SAN DIEGO SUPERCOMPUTER CENTER Agenda -- Day 2 9:00 - 9:30Inside the Inca Depot 9: :00Inca APIs 10: :00Data display (data consumers) 11: :00Hands-on: Inca deployment (part 2) 1:00 - 2:00Hands-on: Data display (data consumers) 2:00 - 3:00Future work and wrap up