1. Computing Facilities & Capabilities
Julian Borrill
Computational Research Division, Berkeley Lab
& Space Sciences Laboratory, UC Berkeley

2. Computing Issues Data Volume Data Processing Data Storage
Data Security
Data Transfer
Its all about the data

3. Data Volume Planck data volume drives (almost) everything LFI : HFI :
22 detectors with 32.5, 45 & 76.8 Hz sampling
4 x 1010 samples per year
0.2 TB time-ordered data TB full detector pointing data
HFI :
52 detectors with 200 Hz sampling
3 x 1011 samples per year
1.3 TB time-ordered data TB full boresight pointing data
LevelS (e.g. CTP “Trieste” simulations) :
4 LFI detectors with 32.5 Hz sampling
4 x 109 samples per year
2 scans x 2 beams x 2 samplings x 7 components + 2 noises
1.0 TB time-ordered data TB full detector pointing data

4. Data Processing
Operation count scales linearly (& inefficiently) with # analyses, # realizations, # iterations, # samples : 100 x 100 x 100 x 100 x 1011 ~ O(10) Eflop
NERSC
Seaborg : 6080 CPU, 9 Tf/s
Jacquard : 712 CPU, 3 Tf/s (21 x Magique-II)
Bassi : 888 CPU, 7 Tf/s
NERSC-5 : O(100) Tf/s, first-byte in 2007
O(2 x 106) CPU-hours/year => O(4) Eflop/yr (10GHz/5%)
USPDC cluster
Specification & location TBD, first-byte in 2007
O(100) CPU x 7000 hours/year => O(0.4) Eflop/yr (5GHz/3%)
IPAC small cluster dedicated to ERCSC

5. Processing 9 Tf/s NERSC Seaborg 3 Tf/s NERSC Jacquard
7 Tf/s NERSC Bassi
0.1 Tf/s ERCSC Cluster
0.5 Tf/s USPDC Cluster
100 Tf/s NERSC 5

6. Data Storage Archive at IPAC Long-term at NERSC using HPSS
mission data
O(10) TB
Long-term at NERSC using HPSS
mission + simulation data & derivatives
O(2) PB
Spinning disk at USPDC cluster & at NERSC using NGF
current active data subset
O(2 - 20) TB
Processor memory at USPDC cluster & at NERSC
running job(s)
O( ) GB/CPU & O( ) TB total

7. Processing + Storage 9 Tf/s 6 TB NERSC Seaborg 2/20 PB NERSC HPSS
2 TB NERSC Jacquard
10 TB
IPAC
Archive
20/200 TB
NERSC
NGF
7 Tf/s
4 TB
NERSC Bassi
0.1 Tf/s
50 GB ERCSC Cluster
2 TB
USPDC
Cluster
0.5 Tf/s
200 GB
USPDC Cluster
100 Tf/s
50 TB
NERSC 5

8. Data Security UNIX filegroups Personal keyfob to access planck acount
special account : user planck
permissions _r__/___/___
Personal keyfob to access planck acount
real-time grid-certification of individuals
fobs issued & managed by IPAC
single system for IPAC, NERSC & USPDC cluster
Allows securing of selected data
e.g. mission vs simulation
Differentiates access to facilities and to data
standard personal account & special planck account

9. Processing + Storage + Security
IPAC KEYFOB
REQUIRED
9 Tf/s
7 TB
NERSC Seaborg
2/20 PB
NERSC
HPSS
3 Tf/s
2 TB
NERSC Jacquard
10 TB
IPAC
Archive
20/200 TB
NERSC
NGF
7 Tf/s
4 TB
NERSC Bassi
0.1 Tf/s
50 GB
ERCSC Cluster
2 TB
USPDC
Cluster
0.5 Tf/s
200 GB
USPDC Cluster
100 Tf/s
50 TB NERSC 5

10. Data Transfer From DPCs to IPAC From IPAC to NERSC
transatlantic tests being planned
From IPAC to NERSC
(check networks/bandwidth with Bill Johnston)
From NGF to/from HPSS
(check bandwidth with David Skinner)
From NGF to memory (most real-time critical)
within NERSC
(check bandwidths with David Skinner)
offsite depends on location
10Gb/s to LBL over dedicated data link on Bay Area MAN

11. Processing + Storage + Security + Networks
IPAC KEYFOB
REQUIRED
9 Tf/s
7 TB
NERSC Seaborg
2/20 PB
NERSC
HPSS
10 Gb/s
3 Tf/s
2 TB NERSC Jacquard
10 Gb/s
10 TB
IPAC
Archive
20/200 TB
NERSC
NGF
DPCs ?
10 Gb/s
10 Gb/s
10 Gb/s
7 Tf/s
4TB
NERSC Bassi ? ? ?
30 Gb/s
0.1 Tf/s
50 GB
ERCSC Cluster
2 TB
USPDC
Cluster
0.5 Tf/s
200 GB USPDC Cluster
100 Tf/s
50 TB
NERSC 5 ?