Detecting anomalies in clinical data using interactive graphics Becca Krouse & Jeremy Wildfire Rho, Inc. November 13, 2018

Introductions About us About Rho, Inc. Mid-sized, full-service CRO in the triangle area Revenue source 50% commercial sponsors 50% federal agencies Rho Center for Applied Data Visualization Build tools tailored to clinical trials research

Outline History and motivation Approach Demo Wrap up Design process Development process Technology Demo Safety charts – web & R Codebook – web & R eDISH Wrap up

History and Motivation Clinical trials require frequent and careful monitoring of safety data Issues with traditional methods of reporting, monitoring, and analyzing based on static tables and listings

Traditional AE table display

History and Motivation Data visualizations allow user to quickly digest patterns within the data However, static graphics are limited to a single snapshot Can fall short if study is large or complex Solution: interactive web-based tools Quickly observe patterns User can interact with the data in real time Drill down to details of interest

Approach

Design process What makes a good tool? Fulfill basic reporting needs Improve accessibility and understanding of data Help separate signal from the noise Quick set up and customization process Based on standardized data Easy to share Design decisions for new tools are informed by older ones

Development process

Development process Agile development Start simple, add features Code reviews and testing Internally, tools are used by study teams and for projects where Rho provides medical monitoring Constant feedback loop Everything is under active development

Technology JavaScript HTML CSS + + R wrapper Web library + Web-based R interface JavaScript HTML CSS + + D3 Webcharts R wrapper (HTML Widgets) R functions Web library + Shiny Apps

Demo

Future work Continue to build and refine our web toolset Emphasis on R development Building out R interfaces for existing tools Statistical integration

Contact Us Email: graphics@rhoworld.com GitHub: github.com/RhoInc

Questions?

Links Rho Github site: github.com/RhoInc Web examples: Safety charts: https://rhoinc.github.io/viz-library/examples/0011-safetyExplorer-queries/aetable.html Paneled outlier explorer: https://rhoinc.github.io/viz-library/examples/0019-paneled-outlier-explorer/ Web-codebook explorer: https://rhoinc.github.io/viz-library/examples/0012-web-codebook-explorer/ eDISH: https://asa-dia-interactivesafetygraphics.github.io/safety-eDISH/test/ R examples: safetyexploreR package Github: RhoInc/safetyexploreR Shiny apps: Becca-krouse.shinyapps.io/aetableapp Becca-krouse.shinyapps.io/safetyapp Datadigest package GitHub: RhoInc/datadigest CRAN: https://cran.r-project.org/web/packages/datadigest/vignettes/datadigest.html