Presentation is loading. Please wait.

Presentation is loading. Please wait.

Us-vo.org/vim VIM Visual Integration and Mining A Tool to Explore Your Sources Roy Williams Caltech T HE US N ATIONAL V IRTUAL O BSERVATORY.

Similar presentations


Presentation on theme: "Us-vo.org/vim VIM Visual Integration and Mining A Tool to Explore Your Sources Roy Williams Caltech T HE US N ATIONAL V IRTUAL O BSERVATORY."— Presentation transcript:

1 us-vo.org/vim VIM Visual Integration and Mining A Tool to Explore Your Sources Roy Williams Caltech T HE US N ATIONAL V IRTUAL O BSERVATORY

2 us-vo.org/vim Start with your sources (currently <1000) Multiple named sky positions –Simple text (RA,Dec,ID) –Text wizard (NVO table importer, today 17.10) –VOTable of positions (local or url) –Push positions from NVO portal

3 us-vo.org/vim Getting Data about your sources

4 us-vo.org/vim hover mouse to enlarge Skyview cutouts in many wavelengths Cen 840 MHz

5 us-vo.org/vim Skyview cutouts in many wavelengths Abell clusters in optical and X-ray

6 us-vo.org/vim Spectral Collections from JHU brokered by NRAO: Arecibo Maser Catalog 2dFGRS SDSS DR5 Hover mouse on thumbnail to see larger image Spectra from VO SSAP services

7 us-vo.org/vim Getting Data about your sources Proximity search

8 us-vo.org/vim Multicone Proximity Search = user-supplied sources + radius returns VOTable radius

9 us-vo.org/vim VIM tables structure –Multiple matches per source –Can join to sources (outer or nearest) RA Dec ID sourcesCat1Cat2

10 us-vo.org/vim Shakbazian galaxy groups prox search in Simbad

11 us-vo.org/vim Table column metadata NED metadata

12 us-vo.org/vim

13 Compute new columns, eg joint IR-optical colors Choose which columns to display

14 us-vo.org/vim Visualization by download & use Topcat

15 us-vo.org/vim Architecture browser Vim personal persistent storage upload sources HTML + AJAX Catalogs (cone) Images (Skyview) Spectra (SSAP) All the relevant information about your sources -- mashups from the VO -- kept for you in persistent storage -- view, mine, download python api Registry Inventory NVO portal

16 us-vo.org/vim Auto-script: Clicking builds script Can edit script and rerun

17 us-vo.org/vim # got some sdss sources from Vizier, a 12 minute radius with rmag<21 # about 773 sources found sources.run(bench, open(mysources.votable').read()) # run 2mass prox search at 2 arc seconds proxsearch.run(bench, survey='2MASS-PSC', sr= , tablename='_2mass', verb='1', maxthreads='10') # merge with the sdss join.run(bench, tablename='_2mass', match='best') # select rows with non-null j magnitude (i.e. thos in 2mass) # we get abouyt 148 remaining selectrows.run(bench, tablename='sources', criterion='! NULL__2mass_j_m') # compute 2mass-J - SDSS-r addcol.run(bench, tablename='sources', colname='JminusR', expression='_2mass_j_m - rmag') # compute 2mass-H - SDSS-z addcol.run(bench, tablename='sources', colname='Hminusz', expression='_2mass_h_m - zmag') # then download sources.votable from Utility/ViewAllFiles, and plot with topcat Vim auto-scripting

18 us-vo.org/vim WebServer or Laptop install Pure python webserver (CherryPy) Scalable Auto-script, edit, rerun paradigm Powered by Stilts (2,000,000,000 rows !) Simple sharing Share your workbench by ing a URL Can write-protect with password VIM Features

19 us-vo.org/vim Content –Any cone search (all 1000s in VOregistry) –Cutouts from Skyview –NVO Inventory services –Spectra via SSAP (from NRAO) Thumbnails and images and FITS Display –Column selection, Row sort/select –Images small-hover-large –Tools and metadata choice –AJAX progress for data fetching …but not Safari :-( VIM Features

20 us-vo.org/vim NVO Portal: Using the registry to get catalogs

21 us-vo.org/vim NVO Portal: Finding catalogs by spatial correlation

22 us-vo.org/vim my sources Catalog A: Perfect correlation Catalog C: No correlation Catalog B: Weak correlation NVO Portal: Inventory service (1000s of catalogs ingested)

23 us-vo.org/vim Questions?


Download ppt "Us-vo.org/vim VIM Visual Integration and Mining A Tool to Explore Your Sources Roy Williams Caltech T HE US N ATIONAL V IRTUAL O BSERVATORY."

Similar presentations


Ads by Google