Presentation is loading. Please wait.

Presentation is loading. Please wait.

Www.eia.gov U.S. Energy Information Administration Independent Statistics & Analysis Transforming legacy data into state-of- the-art interactive visualizations.

Similar presentations


Presentation on theme: "Www.eia.gov U.S. Energy Information Administration Independent Statistics & Analysis Transforming legacy data into state-of- the-art interactive visualizations."— Presentation transcript:

1 U.S. Energy Information Administration Independent Statistics & Analysis Transforming legacy data into state-of- the-art interactive visualizations September 6, 2013 | Washington, D.C. Mark Elbert Director, Office of Web Management

2 What to do when your data is in legacy table structures? Mark Elbert, Washington, D.C., September 6,

3 Challenge: transform EIA’s data publishing 3 chose electricity data, with over 400,000 time series, to break the paper-centric publishing model different customers consume data in different ways: –researchers and energy analysts –classroom of students –Hill staffers –application developers push the boundaries of interactive charting and mapping on the web Mark Elbert, Washington, D.C., September 6, 2013

4 The Internet’s fallow period: ’03 - ’10 4 The internet turned into a powerful computing platform despite Microsoft –Telcos gave us multi megabit bandwidth –Google’s Chrome started the new browser war for speed –processors continued to improve open-source JavaScript libraries matured –jQuery / jQueryUI –jVectorMaps –Highcharts Mark Elbert, Washington, D.C., September 6, 2013

5 Web Data Ingestion and Application Architecture Mark Elbert, Washington, D.C., September 6, legacy tables Web DB Filtering & collating Indexing engine Data mapper Data writer (JSON)

6 The Electricity Data Browser Mark Elbert, Washington, D.C., September 6, aggregate data drill-downs to individual plant data user generated visualizations: –Line charts –Column charts –Animated maps links to analysis, data API Cross links to U.S. Energy Mapping System

7 Data ecosystem Mark Elbert, Washington, D.C., September 6, {"request":{"command":"series","series_id":"ELEC.PLANT.GEN WAT- ALL.A"},"series":[{"series_id":"ELEC.PLANT.GEN.6417-WAT- ALL.A","data":[["2012","244685"],["2011","390119"],["2010"," "],["2009","377491"],["2008","181726"],["2007","102447"],["200 6","292362"],["2005","263951"],["2004","471543"],["2003"," "],["2002","422206"],["2001","285082"]],"name":"Net Generation : Center Hill : Conventional Hydroelectric : All Primemovers : Annual","units":"megawatthours","f":"A","unitsshort":"","descriptio n":"","copyright":"None","source":"EIA, U.S. Energy Information Administration","iso3166":"USA-TN","lat":" ","lon":" ","start":"2001","end":"2012","updated":"22-MAR PM"}]}

8 Demo: 8 Mark Elbert, Washington, D.C., September 6, 2013

9 9

10 10

11 Mark Elbert, Washington, D.C., September 6,

12 Mark Elbert, Washington, D.C., September 6,

13 Mark Elbert, Washington, D.C., September 6,

14 Mark Elbert, Washington, D.C., September 6,

15 each data set is a complete n-Cube Mark Elbert, Washington, D.C., September 6, Ragged n-Cube Complete n-Cube

16 Mark Elbert, Washington, D.C., September 6, NameDescriptionLicenseVersionSizeFirst publishedDependencies jQueryhelper library; simplifies JavaScript coding open-sourcev kBJan-06- jQuery UIuser interface controlopen-sourcev kBSep-07jQuery Highstockscharting librarycommercial ($80)v kBOct-11jQuery jVector Mapmap infographics libopen-sourcev0.123kBFeb-12jQuery USA map definition open-sourcev0.147kBFeb-12jVector Map, jQuery SlickGridfast, scalable grid componentopen-sourcev2.012kBMar-09jQuery, jQuery.event. drag JQuery Event Dragextends jQuery; used by Slickopen-sourcev2.05.1kB jQuery jQuery mousewheelsimplifies mousewheel programming open-sourcev kBApr-07jQuery Loadmaskcreates wait screen effectsopen-sourcev0.44.1kBJun-09jQuery qTipshelp tipsopen-sourcev1.022kBApr-10jQuery Curlloads library as neededopen-sourcev kBJan-11- Classyobjectoriented extension for JavaScript open-sourcev kBApr-10jQuery Crossroadspattern matching frameworkopen-sourcev0.7.15kBApr-11- Hasherurl hash managementopen-sourcev1.12.8kBAug-11- Mustachelogic-less template systemopen-sourcev0.514kBOct-09- SimpleModalcreates modal panel (greys rest of screen) open-sourcev kBOct-07jQuery JSON2provides JSON support for obsolete browsers open-sourcev1.05kBNov-10- PureMVCmodel-view-controller framework open-sourcev1.17kBNov-10- js-Signalsevent frameworkopen-sourcev kBNov-10- Kizzycross-browser localStorage APIopen-sourcev1.04.6kBFeb-11- Open Source libraries = 2/3 code

17 Mark Elbert, Washington, D.C., September 6, Questions? Mark Elbert


Download ppt "Www.eia.gov U.S. Energy Information Administration Independent Statistics & Analysis Transforming legacy data into state-of- the-art interactive visualizations."

Similar presentations


Ads by Google