1. Microsoft Research San Francisco (aka BARC: bay area research center) Jim Gray Researcher Microsoft Research Scalable servers Scalable servers Collaboration – Media Management

2. TerraServer / TerraService http://terraService.Net/ http://TerraServer-USA.com/ http://terraService.Net/http://TerraServer-USA.com/ http://terraService.Net/http://TerraServer-USA.com/ USGS Photo of US Online since June 1998 Operated by Microsoft 20 TB data source 10 M web hits/day A web service Our laboratory

3. KVM / IP TerraServer – Today – LOW TCO Storage Bricks Commodity servers” 4 TB raw / 2 TB Raid1 SATA storage Dual 2 Ghz + 4GB RAM Bunch 3 Bricks = TerraServer data Data partitioned Low Cost Availability Pair & Spare RAID1 Mirroring Mirrored Bunches” Spare Brick Web Application Load balances mirrors Uses surviving database on failure

4. World Wide Telescope World Wide Telescope Premise: Most Astronomy data is online So, the Internet is the world’s best telescope: It has data on every part of the sky In every measured spectral band: As deep as the best instruments (2 years ago). It is up when you are up. The “seeing” is always great (no working at night, no clouds no moons no..). It’s a smart telescope: links objects and data to literature on them.

5. SkyServer.SDSS.org SkyServer.SDSS.org Built with Johns Hopkins U. SkyServer.SDSS.org A modern archive Raw Pixel data lives in file servers Catalog data (derived objects) in Database Online query to any and all Also used for education 150 hours of online Astronomy Implicitly teaches data analysis Interesting things Spatial data search Query interface via Emacs, Perl, Java… Popular -- 1% of Terraserver Popular -- 1% of Terraserver Cloned by other surveys (a template design) Based on Web Services

6. Federation: SkyQuery.Net SkyQuery.Net Combines 15 archives Send query to portal, portal joins data from archives. Evolving Portal to have Personal databases (workbenches) Batch scheduling of monster queries. 2MASS INT SDSS FIRST SkyQuery Portal Image Cutout

7. Transcontinental Disk to Disk Working with CERN and CalTech Network speed: 7.1 Gbps (~900 MBps) New speed record @ http://ultralight.caltech.edu/lsr-winhec/ File Transfer Speed CERN to Pasadena Local disk speed: 1.2 GBps AMD + Newisys + S2io + Win03 Transcontinental disk speed: ~400MBps now, aim for 1GBps OC192 = 9.9 Gbps