1. us-vo.org/vim VIM Visual Integration and Mining A Tool to Explore Your Sources Roy Williams ( Caltech) And the NVO Portal Team T HE US N ATIONAL V IRTUAL O BSERVATORY Part of the NVO Portal

2. us-vo.org/vim Vim is an NVO Portal Component Sources and Resources Find sources (== sky positions) Find resources (== catalog services) Look up sources with resources

3. us-vo.org/vim Start with your sources (currently <1000) Multiple named sky positions –Simple text (RA,Dec,ID) –Text wizard (NVO table importer, today 17.10) –VOTable of positions (local or url) –Push positions from NVO portal

4. us-vo.org/vim Got Text Table? Make a VOTable from plain text using the table wizard. http://us-vo.org/tablewizard

5. us-vo.org/vim Getting Data about your sources

6. us-vo.org/vim hover mouse to enlarge Skyview cutouts in many wavelengths Cen A @ 840 MHz

7. us-vo.org/vim Skyview cutouts in many wavelengths Abell clusters in optical and X-ray

8. us-vo.org/vim Spectral Collections from JHU brokered by NRAO: Arecibo Maser Catalog 2dFGRS SDSS DR5 Hover mouse on thumbnail to see larger image Spectra from VO SSAP services

9. us-vo.org/vim Getting Data about your sources Proximity search AJAX progress

10. us-vo.org/vim Multicone Proximity Search = user-supplied sources + radius returns VOTable radius

11. us-vo.org/vim VIM tables structure –Multiple matches per source –Can join to sources (outer or nearest) RA Dec ID sourcesCat1Cat2

12. us-vo.org/vim Shakbazian galaxy groups prox search in Simbad

13. us-vo.org/vim Table column metadata NED metadata

14. us-vo.org/vim

15. Compute new columns, eg joint IR-optical colors Choose which columns to display

16. us-vo.org/vim Visualization by download & use Topcat

17. us-vo.org/vim Architecture browser Vim personal persistent storage upload sources HTML + AJAX Catalogs (cone) Images (Skyview) Spectra (SSAP) All the relevant information about your sources -- mashups from the VO -- kept for you in persistent storage -- view, mine, download python api Registry Inventory NVO portal VOservices

18. us-vo.org/vim Auto-script: Clicking builds script Can edit script and rerun

19. us-vo.org/vim # got some sdss sources from Vizier, a 12 minute radius with rmag<21 # about 773 sources found sources.run(bench, open(‘mysources.votable').read()) # run 2mass prox search at 2 arc seconds proxsearch.run(bench, survey='2MASS-PSC', sr=0.00055556, tablename='_2mass', verb='1', maxthreads='10') # merge with the sdss join.run(bench, tablename='_2mass', match='best') # select rows with non-null j magnitude (i.e. thos in 2mass) # we get abouyt 148 remaining selectrows.run(bench, tablename='sources', criterion='! NULL__2mass_j_m') # compute 2mass-J - SDSS-r addcol.run(bench, tablename='sources', colname='JminusR', expression='_2mass_j_m - rmag') # compute 2mass-H - SDSS-z addcol.run(bench, tablename='sources', colname='Hminusz', expression='_2mass_h_m - zmag') # then download sources.votable from Utility/ViewAllFiles, and plot with topcat Vim auto-scripting

20. us-vo.org/vim WebServer or Personal install Pure python webserver (CherryPy) Scalable Auto-script, edit, rerun paradigm Powered by Stilts (2,000,000,000 rows !) Simple sharing Share your workbench by emailing a URL http://envoy5.cacr.caltech.edu:8888/?benchID=7462948574635185948473627485958433 Can write-protect with password VIM Features

21. us-vo.org/vim Content –Any cone search (all 1000’s in VOregistry) –Cutouts from Skyview –NVO Inventory services –Spectra via SSAP (from NRAO) Thumbnails and images and FITS Display –Column selection, Row sort/select –Images small-hover-large –Tools and metadata choice –AJAX progress for data fetching …but not Safari :-( VIM Features

22. us-vo.org/vim NVO Portal: Using the registry to get catalogs Either: START at Vim, Catalogs / Find Catalog Services (your workbench remembered) Or: Collect Ivorns from registry and Vim can resolve them Catalogs / Add Catalog by Ivorn, Or: choose “Export results to VIM” from another portal component

23. us-vo.org/vim NVO Portal: Finding catalogs by spatial correlation Input catalog is Brightest BL Lac (38) NVO Portal: Finding catalogs by spatial correlation Input catalog is Brightest BL Lac (38) Science Question: Are BL Lac associated with GRB? Science Question: Are BL Lac associated with GRB?

24. us-vo.org/vim my sources Catalog A: Perfect correlation Catalog C: No correlation Catalog B: Weak correlation NVO Portal: Inventory service (1000’s of catalogs ingested)

25. us-vo.org/vim Questions? VIM is pure python under CherryPy server VIM relies on Stilts and Skyview and YahooUI and NVO Portal Thank you BobGretchenJohnMarkMikeTom et al!