1. 2013-2014 CSA Implementation overview since OR-8 Test campaigns Scheduled development plan
Arnaud Masson CSA/CAA Operational Review 9
ESTEC, 04-June-2014

2. Outline About CAA and CSA CSA releases since OR-8
CSA key requirements implementation over the last two years
Status of the implementation for other data services
Outcome of test campaigns
CSA future developments

3. 1. About CAA and CSA: why do we do all this?

4. 1. About CAA and CSA: why do we do all this?
The scientific return of the Cluster mission

5. 1. About CSA and CAA

6. Online archive fully Public
1. About CSA and CAA
Publications x2
Online archive fully Public

7. 1. About CSA and CAA
CSA is the long term archive of the Cluster and the Double Star missions together with value added products such as ECLAT and MAARBLE
CSA-CAA main goals include
Continue serving a large scientific community (~ 1700 registered users)
Continue to develop the archive (e.g. Double Star datasets)
Make sure this data gold mine is preserved in the long term

8. 2. CSA releases since OR-8

9. 2. CSA releases since OR-8
November Public opening of CSA
V1.0

10. 2. CSA releases since OR-8 November 2013 Public opening of CSA V1.0
March Data streaming
V Pre-gen visualisation plots
Inventory plots
Improved data delivery speed

11. 2. CSA releases since OR-8 November 2013 Public opening of CSA V1.0
March Data streaming
V Pre-gen visualisation plots
Inventory plots
Improved data delivery speed
May New CSA website
V Re-design of the GUI
V Dynamic async icon with nb of datasets

12. 3. CSA key requirements implementation
Cluster Science Archive
Key requirements
June 2014
1 year ago
2 years ago
CSA and CAA data content equivalent
Data delivery in CEF and CDF
GUI without user profiles (data or graphical)
Dataset can be made inactive in the CSA database
Caveat files delivered together with data products
Command-line capabilties (wget, within Matlab/IDL…)
Data visualisation capabilities (on-demand & pregenerated)
Inventory plots (on-demand & pregenerated)

13. 3. CSA key requirements implementation
Cluster Science Archive
Key requirements
June 2014
1 year ago
2 years ago
CSA and CAA data content equivalent
Data delivery in CEF and CDF
GUI without user profiles (data or graphical)
Dataset can be made inactive in the CSA database
Caveat files delivered together with data products
Command-line capabilties (wget, within Matlab/IDL…)
Data visualisation capabilities (on-demand & pregenerated)
On demand
Inventory plots (on-demand & pregenerated)

14. 3. CSA key requirements implementation
Cluster Science Archive
Key requirements
June 2014
1 year ago
2 years ago
CSA and CAA data content equivalent
Data delivery in CEF and CDF
GUI without user profiles (data or graphical)
Dataset can be made inactive in the CSA database
Caveat files delivered together with data products
Command-line capabilties (wget, within Matlab/IDL…)
Data visualisation capabilities (on-demand & pregenerated)
On demand
Inventory plots (on-demand & pregenerated) *

15. 3. CSA key requirements implementation
Cluster Science Archive
Key requirements
June
2014
1 year ago
2 years ago
CSA and CAA data content equivalent
Data delivery in CEF and CDF
GUI without user profiles (data or graphical)
Dataset can be made inactive in the CSA database
Caveat files delivered together with data products
Command-line capabilties (wget, within Matlab/IDL…)
Data visualisation capabilities (on-demand & pregenerated)
On demand
Inventory plots (on-demand & pregenerated) *
YEARLY and Monthly pregen inventory plots available for the period;
DAILY pregen inventory plots available: 7 instruments available, 5 on-going (RAPID, STAFF, WBD, WHI, AUX)
EVERYTHING including plots for 2013 and 2014 shall be available by the end of June 2014

16. 4. Implementation status: other data services
Cluster Science Archive
Data services
Now
1 year ago
2 years ago
Data streaming capabilities
Visualisation of quicklook plots
Visualisation of particle distributions (beta version)
ECLAT and MAARBLE products
Multiline plots for graphical products

17. 4. Implementation status: other data services
Cluster Science Archive
Data services
Now
1 year ago
2 years ago
Data streaming capabilities
Visualisation of quicklook plots
Visualisation of particle distributions (beta version)
ECLAT and MAARBLE products
Multiline plots for graphical products

18. 4. Implementation status: other data services
Cluster Science Archive
Data services
Now
1 year ago
2 years ago
Data streaming capabilities
Visualisation of quicklook plots
Visualisation of particle distributions (beta version)
ECLAT and MAARBLE products
Multiline plots for graphical products

19. 4. Implementation status: other data services
Cluster Science Archive
Data services
Now
1 year ago
2 years ago
Data streaming capabilities
Visualisation of quicklook plots
Visualisation of particle distributions (beta version)
ECLAT and MAARBLE products
Multiline plots for graphical products

20. 4. Implementation status: other data services
Cluster Science Archive
Data services
Now
1 year ago
2 years ago
Data streaming capabilities
Visualisation of quicklook plots
Visualisation of particle distributions (beta version)
ECLAT and MAARBLE products
Multiline plots for graphical products
CSDS quicklook plots can be browsed from CSDS websites and the CSA website
CSDS quicklook plots can be downloaded from CSA
Instrument based on PI software QL plots available in October
ECLAT and MAARBLE visualisation will be available in October
Cross-calibration QL plots visualisation in October
CAA based CSDS quicklook plots, still require finetuning,not yet sent to CSA

21. 4. Implementation status: other data services
Cluster Science Archive
Data services
Now
1 year ago
2 years ago
Data streaming capabilities
Visualisation of quicklook plots
Visualisation of particle distributions (beta version)
JULY
ECLAT and MAARBLE products
Multiline plots for graphical products

22. 4. Implementation status: other data services
Cluster Science Archive
Data services
Now
1 year ago
2 years ago
Data streaming capabilities
Visualisation of quicklook plots
Visualisation of particle distributions (beta version)
JULY
ECLAT and MAARBLE products
Multiline plots for graphical products

23. 4. Implementation status: other data services
Cluster Science Archive
Data services
Now
1 year ago
2 years ago
Data streaming capabilities
Visualisation of quicklook plots
Visualisation of particle distributions
JULY
ECLAT and MAARBLE products
Multiline plots for graphical products
Available today!

24. 4. Implementation status: other data services
Cluster Science Archive
Data services
Now
1 year ago
2 years ago
Data streaming capabilities
Visualisation of quicklook plots
Visualisation of particle distributions (beta version)
JULY
ECLAT and MAARBLE products
Multiline plots for graphical products

25. 4. Implementation status: other data services

26. 4. Implementation status: other data services
Multiline plots
Available
On the CSA
Internal server
Will be released
In June 2014
V1.1.3.

27. 5. Outcome of the testing of CSA wrt CAA
Procedure
Outcome
Data delivery
Simultaneous download of every single dataset for different time periods, comparison of size
Equivalent
5 datasets from STAFF and WBD in burst mode were found to be delivered incorrectly by CSA
now ok

28. 5. Outcome of the testing of CSA wrt CAA
Procedure
Outcome
Data delivery
Simultaneous download of every single dataset for different time periods, comparison of size
Equivalent
5 datasets from STAFF and WBD in burst mode were found to be delivered incorrectly by CSA
now ok
Graphical pregen plots
accessibility/usability (GUI)
Data visualisation of pregen graphical plots on both systems (functionalities, time it takes)
Equivalent for 24h&6h
Minor issue: 1h pregen plot not yet available

29. 5. Outcome of the testing of CSA wrt CAA
Procedure
Outcome
Data delivery
Simultaneous download of every single dataset for different time periods, comparison of size
Equivalent
5 datasets from STAFF and WBD in burst mode were found to be delivered incorrectly by CSA
now ok
Graphical pregen plots
accessibility/usability (GUI)
Data visualisation of pregen graphical plots on both systems (functionalities, time it takes)
Equivalent for 24h&6h
Minor issue: 1h pregen plot not yet available
Graphical on-demand plots accessibility/usability (GUI)
Data visualisation of on-demand graphical plots on both systems (functionalities, time it takes)

30. 5. Outcome of the testing of CSA wrt CAA
Procedure
Outcome
Data delivery
Simultaneous download of every single dataset for different time periods, comparison of size
Equivalent
5 datasets from STAFF and WBD in burst mode were found to be delivered incorrectly by CSA
now ok
Graphical pregen plots
accessibility/usability (GUI)
Data visualisation of pregen graphical plots on both systems (functionalities, time it takes)
Equivalent for 24h&6h
Minor issue: 1h pregen plot not yet available
Graphical on-demand plots accessibility/usability (GUI)
Data visualisation of on-demand graphical plots on both systems (functionalities, time it takes)
Inventory on-demand plots accessibility/usability (GUI)
Visualisation of on-demand, up to 7 days, inventory information

31. 5. Outcome of the testing of CSA wrt CAA
Procedure
Outcome
Data delivery
Simultaneous download of every single dataset for different time periods, comparison of size
Equivalent
5 datasets from STAFF and WBD in burst mode were found to be delivered incorrectly by CSA
now ok
Graphical pregen plots
accessibility/usability (GUI)
Data visualisation of pregen graphical plots on both systems (functionalities, time it takes)
Equivalent for 24h&6h
Minor issue: 1h pregen plot not yet available
Graphical on-demand plots accessibility/usability (GUI)
Data visualisation of on-demand graphical plots on both systems (functionalities, time it takes)
Inventory on-demand plots accessibility/usability (GUI)
Visualisation of on-demand, up to 7 days, inventory information
Inventory pregen plots
Accessibility/usability
(GUI)
Visualisation of inventory pregenerated plots (functionalitites and time it takes)
Equivalent for Yearly&Monthly ( )
Daily ok for 7 experiments
(e.g. FGM, CIS, PEACE)
5 on-going

32. 5. Outcome of the testing of CSA wrt CAA

33. 5. Outcome of the testing of CSA wrt CAA

34. 5. Outcome of the testing of CSA wrt CAA

35. 5. Outcome of the testing of CSA wrt CAA

36. 5. Outcome of the testing of CSA wrt CAA

37. 6. Scheduled development plan
Mid-June 2014
Multiline plots available at the CSA GUI
End of June 2014
Public access closing of CAA
End of July 2014
Main goals
Distribution functions visualisation (beta version)
Improvement of the speed of data streaming
Mid-October 2014
Double star data accessible via the GUI and the command line
Visualisation of FP7 projects graphical products
Visualisation of quicklook plots based on the CSA data
End of November 2014
Implementation of the SAMP protocol
End of the year 2014
Fix of the remaining minor issues