1ICALEPCS, October 15-19, 2007, Knoxville, Tennessee Association Euratom-Cea Ph. Moreau Association EURATOM-CEA Département de Recherches sur la Fusion Contrôlée CEA-Cadarache F Saint Paul-lez-Durance, FRANCE IMPROVEMENT OF TORE SUPRA REAL TIME PROCESSING CAPABILITY USING REMOTE PCs October 15-19, 2007 Knoxville, TN Ph. Moreau, B. Guillerminet, F. Leroux, D. Molina, N. Ravenel

2ICALEPCS, October 15-19, 2007, Knoxville, Tennessee Association Euratom-Cea Ph. Moreau Outline  The Tore Supra tokamak  The Tore Supra Data Acquisition System  Data Acquisition System requirements  New architecture using remote PCs  Conclusion and future work

3ICALEPCS, October 15-19, 2007, Knoxville, Tennessee Association Euratom-Cea Ph. Moreau The Tore Supra Tokamak Tore Supra is one of the largest superconducting tokamak (1 st plasma 1988)  Devoted to long duration, high performance plasma discharge researches  R = 2.42m, a = 0.72m, Ip= 1.5MA, B tor = 4.5T  50 diag. and sub-systems synchronized and operated at the same time  RT acquisition and control is essential

4ICALEPCS, October 15-19, 2007, Knoxville, Tennessee Association Euratom-Cea Ph. Moreau Tore Supra Data Acquisition Time Scales A day of experiments at Tore Supra = Tokamak commissioning, plasma discharges, decommissioning  Continuous acquisitions 24h a day (  t ~ 1s) Plant monitoring (  PLC)  Standard acquisitions (  t ~ 1ms) during the entire plasma discharge. Global analysis of the physic of the discharge  Fast acquisitions (  t ~ 1µs or less) triggered by plasma events Essential for studying fast events (plasma deep understanding) Superconducting coil current (kA) Plasma current (MA) Superconducting coil Temp (°C) Time (hours) * plasma current (MA) Plasma density (* m -3 ) Plasma central temperature (keV) December 4 th, 2003 Time (min) Time (s) Magnetic perturbation Trigger Time (s) Physical analysis Freq (kHz) 4

5ICALEPCS, October 15-19, 2007, Knoxville, Tennessee Association Euratom-Cea Ph. Moreau Tore Supra Data Acquisition System Ethernet Gigabit Timing system Ethernet 10MB/s Ethernet 10MB/s Ethernet 10MB/s PCs Acquisition (12 units) Real Time shared memory network (20 nodes) Interlock syst (based on PLC) Mutlibus Acquisition (9 units) VME Acquisition (27 units) Servers Data Database Develop. Real Time Processing PC dispatch Display Terminals Compiler Server Compiler Server

6ICALEPCS, October 15-19, 2007, Knoxville, Tennessee Association Euratom-Cea Ph. Moreau Evolution of Requirements Over the Years Amount of data (Mo) per shot Year Continuous Post processing Raw (standard+fast) 1045 shots (*) Gran total GB (*) Until June 2822 shots Gran total GB 2004 shots Gran total GB 1863 shots Gran total GB 1474 shots Gran total GB 970 shots Gran total 34.3 GB 1461 shots Gran total 86.3 GB  Average row data volume increased by a factor 5 (#channels increases, fast acquisition increases)  diag. cannot any more handle data flux  Total amount of data per year increased by a factor 17

7ICALEPCS, October 15-19, 2007, Knoxville, Tennessee Association Euratom-Cea Ph. Moreau Tore Supra Requirements of Fast Data Acquisition TS#36933 Example: injection of frozen Deuterium pellets Time (s) Density (* m -3 ) Fast acquisition e - temperature (keV) Triggers TS# Time (s) 10’000 points 32 channels Fast acquisition e - temperature (keV) Delay between triggers Example: injection of frozen Deuterium pellets To be considered:  Flow rate (sampling frequency and # channels)  Duration of the fast acquisition  Minimum delay between 2 triggers (  t trig )

8ICALEPCS, October 15-19, 2007, Knoxville, Tennessee Association Euratom-Cea Ph. Moreau Flow Rate Requirements for Fast Acquisition  Five diagnostics are on concern by the modifications  Specifications depend on diagnostic Magnetics ECE MSE Reflec. fluctuation Example of data flow rate variation during a plasma discharge Reflec. doppler Data flow rate Acquisition duration Delay between triggers 6.0 MB/s0.500 s< 0.5 s 7.0 MB/s0.500 s< 0.5 s 8.0 MB/s1.000 s~ 5 s 4.0 MB/s1.000 s~ 1 s 18.0 MB/s s< 0.5 s MAG ECE MSE Ip (100kA) Time (s) Data Flow rate (MB/s)

9ICALEPCS, October 15-19, 2007, Knoxville, Tennessee Association Euratom-Cea Ph. Moreau Limitations of VME Acquisition Units RT server Data server + database Acquisition param (given by user) Diagnostic (analog data) ADCStorage board Flip flop buffer VME bus (1MB/s) (no DMA) CPU #2 RT processing Timing board Events CPU #1VME bus Data extraction Data validation Strategy application Frame processing Publishing FrameBuffer VME crate Switch Ethernet 750kB/s Ethernet Gigabit 70MB/s (2MB/s) (no DMA)  CPU#2 runs one single task dedicated to RT processing  CPU#1 runs several tasks in parallel Other diagnostics

10ICALEPCS, October 15-19, 2007, Knoxville, Tennessee Association Euratom-Cea Ph. Moreau Limitations of VME Acquisition Units Data Flow rate (MB/s) 0 Diagnostic ADC Buffer CPU#1 (Power PC 166 – 300MHz) Buffer Switch RT server Storage In-Flux 8 MB/s VME bus 2 MB/s (no DMA) Frame processing 525 kB/s Ethernet 750 kB/s Gigabit 70 MB/s Main limitations:  ADC buffer size = 2MB  Full for fast acquisition longer than 333ms  speed up the VME bus transfer  Acquisition = 125ms  1MB  3.7s to leave the VME crate  30 times longer!  speed up the frame processing and Ethernet connection Signal path

11ICALEPCS, October 15-19, 2007, Knoxville, Tennessee Association Euratom-Cea Ph. Moreau Upgrade of VME Capability: Remote PCs Diagnostic (analog data) ADCStorage board Flip flop buffer VME bus (1MB/s) (no DMA) CPU #2 RT processing Timing board Events CPU #1VME bus FrameBuffer VME crate Switch Ethernet 750kB/s Ethernet Gigabit 70MB/s Data extraction Data validation Strategy application Frame processing Publishing (2MB/s) (no DMA)  DMA transfer implemented in acquisition board driver (20MB/s) (Driver modified DMA) Data extraction Data validation Fast Ethernet 7.0MB/s Data RT server Data server + Database Acquisition param (given by user) Strategy application Frame processing Publishing Remote PC CPU - 3GHz Linux OS Monitoring Other diagnostics  Software in CPU#1 split in independent parts (can be run on different computers)  Network bandwidth between VME crate and switch increased (Fast Ethernet)

12ICALEPCS, October 15-19, 2007, Knoxville, Tennessee Association Euratom-Cea Ph. Moreau Upgrade of VME Capability: Remote PCs Diagnostic ADC Buffer RT server Storage Signal path Switch Remote PC (Intel P-IV 2.8GHz Linux OS) Data Flow rate (MB/s) 0 Gigabit 70 MB/s In-Flux 8 MB/s VME bus 20 MB/s (DMA) Data transfer 60 MB/s Fast Ethernet 7 MB/s Frame Processing 60 MB/s Gigabit 70 MB/s Improvement of performance by a factor ~10  Minor modification of the hardware (cost, human resources)  Remote PC is an evolving system vs the VME at Tore Supra  A PC is able to deal with 3 VME frame processing tasks  Last limit is the Fast Ethernet connection (modification requires new VME CPU  major modifications) CPU#1 (Power PC 166 – 300MHz) Buffer

13ICALEPCS, October 15-19, 2007, Knoxville, Tennessee Association Euratom-Cea Ph. Moreau The Monitoring Interface Remote PC # Frames waiting # Frames sent to RT server VME crate Board number # packets received by remote PC # packets sent to remote PC # packet waiting  Java based application for monitoring fast acquisition processes  Indicates the status of VME crate processes and remote PC frame builder

14ICALEPCS, October 15-19, 2007, Knoxville, Tennessee Association Euratom-Cea Ph. Moreau Conclusion  Remote PCs = solution to the requirement of fast acquisition at Tore Supra while the hardware remains the same.  At present applied routinely on 2 diagnostics (tests on a 3 rd one)  Performance increased by a factor 10  A remote PC is able to accommodate 3 diag. using fast acquisition  Monitoring tool for data processing all along its path have been developed Future developments: Integrate advanced RT processing from fast acquisition  Refine analysis of the plasma  more accurate control  Possibility to be more efficient in plasma recovery strategies (See poster F. Saint-Laurent) Acquisition duration (s) 0 Diagnostic data flow (MB/s) Acquisition parameters for  tTrig  1s With remote PC Without remote PC

15ICALEPCS, October 15-19, 2007, Knoxville, Tennessee Association Euratom-Cea Ph. Moreau Thank you for your attention !

16ICALEPCS, October 15-19, 2007, Knoxville, Tennessee Association Euratom-Cea Ph. Moreau Conclusion Magnetics ECE MSE Reflec. fluctuation Reflec. doppler Data flow rate Acquisition duration Delay between triggers 6.0 MB/s0.500 s< 0.5 s 7.0 MB/s0.500 s< 0.5 s 6.0 MB/s1.000 s~ 5 s 4.0 MB/s1.000 s~ 1 s 18.0 MB/s s< 0.5 s  Remote PCs = solution to the requirement of fast acquisition at Tore Supra while the hardware remains the same  At present applied routinely on 2 diagnostics (tests on a 3 rd one)  A remote PC is able to accommodate 3 diag. using fast acquisition  Monitoring tool for data processing all along its path have been developed Future developments: Integrate advanced RT processing from fast acquisition  Refine analysis of the plasma  more accurate control  Possibility to be more efficient in plasma recovery strategies (See poster F. Saint-Laurent) New DAS

17ICALEPCS, October 15-19, 2007, Knoxville, Tennessee Association Euratom-Cea Ph. Moreau Many diagnostics and sub-systems

18ICALEPCS, October 15-19, 2007, Knoxville, Tennessee Association Euratom-Cea Ph. Moreau Acquisition duration (s) 0 Diagnostic data flow (MB/s)