1. Data acquisition system on Advanced TCA M. Nomachi and S. Ajimura Osaka University, Japan CAMAC – FASTBUS – VME / Compact PCI What ’ s next?

2. ATCA JAN-20062 Rack Crate Module Chip Memory Mapped I/O CPU Network DAQ architecture & Downsizing Memory Mapped I/O CPU Network CPU Network

3. ATCA JAN-20063 CPU: merits and demerits Merits –Scalable, easy to communicate –Data base access Demerits –Boot –Overhead –Maintenance

4. ATCA JAN-20064 Rack Crate Module Chip Memory Mapped I/O CPU Network DAQ architecture We choose memory mapped I/O in a crate. It makes easy to maintain CPU. There were many bad experiences on embedded CPUs.

5. ATCA JAN-20065 産業界の動向 VME –6U Euro card DIN connector –BUS Compact PCI –6U Euro card metric connector –BUS ATCA –8U Euro card metric connector –Serial link

6. ATCA JAN-20066 From Schroff

7. ATCA JAN-20067

8. 8

9. 9

10. 10 There are 4 ports for one channel. One port has one output and one input. In order to make signal extraction easy, 2 ports are used. (SpW uses 2 ports) The other 2 ports are to extend band width. It makes possible to use 4-layers PCBs.

11. ATCA JAN-200611 From Schroff

12. ATCA JAN-200612

13. ATCA JAN-200613 Advanced TCA Features –-48V DC power supply and on board DC converter for any voltages required. –8U x 280 mm –Dual Star point to point differential connection –No definite protocol. VME back plane is for VME protocol. While, ATCA back plane is only defined as 100 ohm differential. Any protocol can use ATCA back plane. ( for example, ATCA for physics instrumentation)

14. ATCA JAN-200614 Read out module Trigger module Front-end module DAQ system Front-end Pipe-line buffer readout buffer Trigger logic Trigger control Global trigger Readout control network Second level trigger CPU To event builder

15. ATCA JAN-200615 Dual star connection Trigger module Read out module Front-end module Front-end module Front-end module Front-end module Front-end module Asynchronous signals (4 lines) Trigger/Reset Local trigger/Busy SpaceWire link (4 lines) CPU (T-kernel)

16. ATCA JAN-200616 Serial data transfer フロントエンドで使用するためには フロントエンドの小規模なＦＰＧＡに実装できる簡単 なプロトコル。 多くのシリアル転送ではクロックの再構築のためのＰＬＬが必要であるが、フロ ントエンドで使用するにはＰＬＬがなくても動作するプロトコルが望ましい。 高速レスポンスを実現するための短い遅延時間。 パイプライン処理を行わないフロントエンドでは遅延時間がそのまま Dead Time となってしまう。このため余計な処理を行わない単純なプロトコルが望ましい。 ノイズ源とならない信号レベル。 デジタル信号の遷移はアナログ系のノイズ源となる。このため、ＬＶＤＳ等、振 幅の小さい信号レベルが望ましい。

17. ATCA JAN-200617

18. ATCA JAN-200618 Steve Parkes 2003

19. ATCA JAN-200619 Steve Parkes 2003 非同期に動作するため、時間情報を保存して送ることが可能

20. ATCA JAN-200620 Steve Parkes 2003

21. ATCA JAN-200621 Steve Parkes 2003

22. ATCA JAN-200622 Steve Parkes 2003

23. ATCA JAN-200623 Steve Parkes 2003

24. ATCA JAN-200624 Steve Parkes 2003

25. ATCA JAN-200625 Steve Parkes 2003

26. ATCA JAN-200626 Steve Parkes 2003

27. ATCA JAN-200627 Steve Parkes 2005

28. ATCA JAN-200628 Steve Parkes 2005

29. ATCA JAN-200629 Steve Parkes 2005

30. ATCA JAN-200630 Steve Parkes 2005

31. ATCA JAN-200631 Steve Parkes 2005

32. ATCA JAN-200632 Steve Parkes 2005

33. ATCA JAN-200633 Write Operation Write Request Write Data Request Write Command Write Reply Write Complete Confirmation Source Destination Write Data Authorisation Write Data Indication Steve Parkes 2005

34. ATCA JAN-200634 Read Operation Read Request Read Data Request Read Command Read Reply Read Data Confirmation Source Destination Read Data Response Steve Parkes 2005

35. ATCA JAN-200635 SpaceWire Remote Memory Access Protocol (RMAP) –RMAP is a protocol on the SpaceWire standard. –Register access has large overhead. –Block transfer works almost full speed. –It meets the requirements. Good enough. –PCI express and the other protocol may also meet the requirements. However, they may use too much logic (x10) for front-end FPGAs.

36. ATCA JAN-200636 Interrupt on VME bus Interrupter Interrupt handler Interrupt Request Broadcast Read Vector Communication between strangers.

37. ATCA JAN-200637 User program Device Send return address Device access Wake up message RMAP read processing Response in 10~100 micro sec

38. ATCA JAN-200638 Interrupt register(event flag) Return address timer Wait event Wake up message Read wake up message -1 : Busy. Another process is already waiting. 0: Event already exist. n>0 : Event occurs after “n” tick. Write interrupt register 0 : cancel Hardware implementation

39. ATCA JAN-200639 ATCA crate One crate holds 96ch of 500MHz FADCs. Total power is expected to be 260 W.

40. ATCA JAN-200640 Virtual CAMAC on serial data link One crate holds 96ch of 500MHz FADCs. Total power is expected to be 260 W. Crate controller Serial data way

41. ATCA JAN-200641 Trigger module 16 LVDS in 16 LVDS out 8 NIM in 8 NIM out Power consumption is about 10W Cyclone EP1C12 for trigger logic Cyclone EP1C6 for SpW 100Mbps SpW

42. ATCA JAN-200642 500 MHz FADC Cyclone EP1C6 Cyclone EP1C12 for router 100Mbps SpW (8~9 MB/s from the module) Readout buffer with 128Mb SDRAM waiting second level trigger 8 ch analog input FADC mezzanine card is developed at KEK (FINESSE format) Power consumption is About 20W

43. ATCA JAN-200643 Summary SpaceWire Remote Memory Access Protocol provides compact and flexible interconnection in a module and inter- module connection. Advanced TCA provide dual star LVDS connections. They are good to be applied for DAQ system Downsizing may continue. –We might have another solution in the future.