Simple and Intuitive Visualization with the Web Automation and Translation Toolkit (WATT) Client Minnesota Supercomputing Institute Undergraduate Internship Program Adam R. Momsen in collaboration with Professor David Yuen and the Virtual Laboratory for Earth and Planetary Materials (VLAB) Minnesota Supercomputing Institute Undergraduate Internship Program Adam R. Momsen in collaboration with Professor David Yuen and the Virtual Laboratory for Earth and Planetary Materials (VLAB)

Project Goals G Create an online service for easy data visualization G Support fast development updates to limit service downtime G “Write once, install anywhere” using Java Webstart G Create an online service for easy data visualization G Support fast development updates to limit service downtime G “Write once, install anywhere” using Java Webstart

WATT Client - Introduction WATT Client - Introduction Consists of two parts: - Manipulator Window - Swing GUI Consists of two parts: - Manipulator Window - Swing GUI Current start page upon WATT Client launch

How the Client Works Send Update Request Returns new “snapshot” Setup allows user to focus on data manipulation while server does the heavy lifting

Manipulator Window G Manipulator box based on GLEEM (“GL Extremely Easy-to-use Manipulator) by Kenneth B. Russell G Clicking corners scales, outside handles rotate, faces translate G JPEG “snapshot” of 3D rendered data mapped to plane within manipulator G Manipulator box based on GLEEM (“GL Extremely Easy-to-use Manipulator) by Kenneth B. Russell G Clicking corners scales, outside handles rotate, faces translate G JPEG “snapshot” of 3D rendered data mapped to plane within manipulator

GLEEM Classes GLEEM Classes G Manip G ManipManager G ManipMotionListener G ManipPart G ManipPartCube G ManipPartGroup G ManipPartLineSeg G ManipPartSquare G ManipPartTransform G ManipPartTriBased G and more! G Manip G ManipManager G ManipMotionListener G ManipPart G ManipPartCube G ManipPartGroup G ManipPartLineSeg G ManipPartSquare G ManipPartTransform G ManipPartTriBased G and more! Class list gives an idea of the complexity of graphical programming; in this case, just about every part of the manipulator has its own class! List only includes manipulator classes, transformers and viewers omitted

Rotating the Manipulator G Source of earliest headaches: matching server and client camera and actor rotations - Server renders images using Visualization Toolkit (VTK), while client uses JOGL - Rotating object same as changing camera, but more computationally expensive - And always remember to agree on degrees or radians! G Source of earliest headaches: matching server and client camera and actor rotations - Server renders images using Visualization Toolkit (VTK), while client uses JOGL - Rotating object same as changing camera, but more computationally expensive - And always remember to agree on degrees or radians!

Scaling and Translating G Scaling - image and box are simply stretched and compressed as the user wills. G Translating - Camera panned freely along a plane parallel to initial JPEG orientation (gives illusion of moving box object) G Scaling - image and box are simply stretched and compressed as the user wills. G Translating - Camera panned freely along a plane parallel to initial JPEG orientation (gives illusion of moving box object)

JPEG Image To ease transmission, only a 2D image is displayed on the client, not a fully rendered 3D object. This made matching up the image and the manipulator difficult, and had to be addressed when rotating the client camera. To ease transmission, only a 2D image is displayed on the client, not a fully rendered 3D object. This made matching up the image and the manipulator difficult, and had to be addressed when rotating the client camera.

Client in Action

Java Swing Interface G Adding a Menu Bar will allow access to developmental and function information and commands to load data. G Input fields allow for manipulation of red cutting plane (visible in previous slide) G JButton allows for quick updates G Note: GUI functionality still in development G Adding a Menu Bar will allow access to developmental and function information and commands to load data. G Input fields allow for manipulation of red cutting plane (visible in previous slide) G JButton allows for quick updates G Note: GUI functionality still in development

Maven 2 G Build structure and program (similar in idea to Ant, Java’s version of Make) - Sets up a generic project file structure that needn’t be rewritten for new projects - Standardizes project for collaborative development - Compiles, tests, builds, installs, deploys - Remote deployment allows new versions to be installed to service URL in a matter of seconds G Build structure and program (similar in idea to Ant, Java’s version of Make) - Sets up a generic project file structure that needn’t be rewritten for new projects - Standardizes project for collaborative development - Compiles, tests, builds, installs, deploys - Remote deployment allows new versions to be installed to service URL in a matter of seconds

Java Webstart G Central to “write once, install anywhere” motto - Service requires no software to be installed prior to use - User only has to accept, and Webstart will search for and download all the files the service needs to run G Central to “write once, install anywhere” motto - Service requires no software to be installed prior to use - User only has to accept, and Webstart will search for and download all the files the service needs to run

Challenges G Initial confusion on project purpose G Box perspective while translating G Image quality issues at high magnification G Matching rotations G Integrating GUI to render window G “No jogl.jar on classpath” error G Hit Points (detecting mouse clicks) - Switching to spherical handles - Point detection determines transformation type G Initial confusion on project purpose G Box perspective while translating G Image quality issues at high magnification G Matching rotations G Integrating GUI to render window G “No jogl.jar on classpath” error G Hit Points (detecting mouse clicks) - Switching to spherical handles - Point detection determines transformation type

Looking ahead G Embed service into webpage with AJAX - Allows for real-time image manipulation without need for constant page updates G Xith3D integration - JOGL overlay that may improve performance G Color map cutting plane G Low-resolution subset - Allows user to better predict final orientation of image G Embed service into webpage with AJAX - Allows for real-time image manipulation without need for constant page updates G Xith3D integration - JOGL overlay that may improve performance G Color map cutting plane G Low-resolution subset - Allows user to better predict final orientation of image

What I Learned G Graphical programming in OpenGL G Java Webstart G Maven large-scale project builds for collaborative efforts (restrictions on project source) G SVN versioning for group collaboration G Professional programming project experience G Graphical programming in OpenGL G Java Webstart G Maven large-scale project builds for collaborative efforts (restrictions on project source) G SVN versioning for group collaboration G Professional programming project experience

Acknowledgements G Professor Dave Yuen’s group: - Evan “Farmer” Bollig - Shuo “Mark” Wang - Martin “Frank Linux” Lyness - Sarah Wieber - Matthew Broten - Grace Schwab - Javier Roman - Paul “Pau Yensen” Jensen - Dan “Rao” Kigelman - Pedro Silveira - Cesar Da Silva G Professor Dave Yuen’s group: - Evan “Farmer” Bollig - Shuo “Mark” Wang - Martin “Frank Linux” Lyness - Sarah Wieber - Matthew Broten - Grace Schwab - Javier Roman - Paul “Pau Yensen” Jensen - Dan “Rao” Kigelman - Pedro Silveira - Cesar Da Silva

References G - OpenGL tutorials G - more OpenGL source G Davis, Tom, Jackie Neider, Dave Shreiner, and Mason Woo. “OpenGL Programming Guide”. Addison-Wesley, Boston “The Red Book” G - Xith3D documentation G - Rendering and culling reference G - Java Swing example G - my VLAB Wiki page G - OpenGL tutorials G - more OpenGL source G Davis, Tom, Jackie Neider, Dave Shreiner, and Mason Woo. “OpenGL Programming Guide”. Addison-Wesley, Boston “The Red Book” G - Xith3D documentation G - Rendering and culling reference G - Java Swing example G - my VLAB Wiki page