1. Tango archiving @ SOLEIL
24/02/2019
G. Abeillé - SOLEIL

2. Software architecture
Device
Archiver
Collect
data
Insert
Database
Device
Monitor health
Tango Control system
Watcher
24/02/2019

3. SOLEIL Archiving system
Computer room 1
Normal service
Computer room 2
Degraded service
VM Cluster
Tango Devices
Replica VM Cluster
Tango Devices
3 nodes Oracle RAC DB
 Degraded  Oracle DB
Business continuity
Disaster Recovery Time:
toutes les 4 heures, les données de conf d'archivage (tables ADT,APT,AMT) sont recopié dans une base de données stand alone distante (salle RGI1).
un script permet de changer la chaine de connexion des device d'archivage (temps d'execution : 2 secondes).
pour activer le PRA (passer en mode dégradé), il faut lancer le script et redémarrer les devices d'archivage
durée de recopie des données du PRA vers la PROD: environ 1 heure par jour à recopier.
Le PRA est mise en place pour HDB machine, HDB ligne, SNAP ligne
Machine HDB
TDB
SNAP
Beamlines
HDB
Snap
Machine HDB
SNAP
Beamlines
HDB
SNAP

4. Figures System Attributes Rate Database HistoricalDB on Accelerators
17368 attrs
700 insert/sec
7 TB
100GB/month
TemporaryDB on
9400 attrs
4000  insert/sec
20 GB/day
Erase up at every shutdown
HDB on
29 Beamlines
4700 attrs
1   insert/sec
1.1 TB
50 GB / month

5. Accelerator Running Devices
270 HDBArchiver devices
300 TDBArchiver devices
Archivers are now deployed on virtual servers …
Rajouter la même pour 1 ou 2 lignes

6. Beamlines Running devices
5 HDBArchiver devices
per beamline

7. Latest changes
The SOLEIL archiving system is in operation since many years
Considering that SOLEIL’s users are not demanding so many new features, the latest changes are only minor bug fixes and evolutions:
Possibility to run SQL requests with a new GUI DataBaseConnection tester
Archivers devices: Better reconnection mechanism in case of database connection loss
Archivers : add a cache for attribute ids to avoid database overload
Better information messages in the watcher device

8. Proposals for the future
The Tango Archiving system still has to evolve to provide a better quality of service and face future challenges. OPEN to discussions:
HDB/TDB Archivers performances enhancement
Simplify operation of the archiving system: Provide keys indicators and rise alarms as soon an error occurs
Better Tango events management in Archiving API
Towards a common functional extraction API for all tango bindings
Make Mambo compatible with hdb++ extraction API
Study of a use case for NoSQL hdb++ for SOLEIL
Propose an extraction service with integrated data decimation to extract big volumes of data
24/02/2019
G. Abeillé, A.Buteau, N.Leclercq : SOLEIL

9. Conclusion
Reminder : Last Archiving package is available on Tango green site (tools):
(last release = )
Features requests or bug tracking
Please use the SourceForge tracker

10. G. Abeillé, A.Buteau, N.Leclercq : SOLEIL
Thank you!
Any questions?
24/02/2019
G. Abeillé, A.Buteau, N.Leclercq : SOLEIL