1. Beam Wire Scanner (BWS) serial link requirements and architecture
BI-BWS LINK
Beam Wire Scanner (BWS) serial link requirements and architecture
J. Emery for the BWS electronics team
Ad-hoc BI-TB meeting for inter-FPGA communication

2. BWS system connections
BI-BWS LINK
BWS system connections
PHASE 2
T IMING
General Machine Timing (GMT) Low jitter < 1ns, Granularity: 1ms
BST receiver
Beam Synchronous timing (BST) Bunch synchronisation (25 ns accurate clock)
Revolution frequency synchro Triggers: scan start, post-mortem Granularity: 89us (LHC), low jitter < 1ns
Beam Energy and Intensity
CISV or BCT ?
CISV receiver ?
PHASE 1
Expert monitoring
FESA class
Serial link
ACQUISITION AND SUPERVISION
Ethernet TCP/IP – RJ45/SFP+
Serial link
INTELLIGENT DRIVE
Control room (CCC)
Logging storage Long term storage for offline analysis
Settings
CPU
Trigger input
BWS Drive code
BI-TB for inter-FPGA communication - J.Emery

3. BWS link services requirement list
BI-BWS LINK
Data integrity Error detection, correction and/or retransmission. Notification and statistics.
Event transport Trigger and IO port replication between the 2 ends Link latency jitter < 0.1us, (1km ~5us, Fused Silica 10°C up => +27ps) Automatic transmission time evaluation
Transparent interconnect SoC bus Interconnection of internal FPGA bus transparently (Memory Mapping), data blocks transfer between FPGA (2 directions), use of DMA mechanism, etc. PSB >= 118 Mbits/s
Streaming links Interconnection of internal FPGA bus transparently (Stream interfaces: >= 1Mbit/s) transparent connections for streaming mechanism
Virtual JTAG over the link (investigation) JTAG chain over the link: Use of vendor tool for logic analyser (SignalTap), memory/register content modification, probing by using Boundary Scan (tbc)
None-volatile memory management External flash management over the link. Read/write flash of program or settings.
Fused Silica, SiO2 Glass Properties
Coefficient of Thermal Expansion 0.55*10–6/°C (10–6/°F)
1km * 10 * 0.55e-6 = m = 5.5mm
5.5mm => 27ps
Listed in the technical specification “Beam wire scanner data and events digital link” EDMS
BI-TB for inter-FPGA communication - J.Emery

4. IP core concept BI-BWS LINK Virtual Event link FPGA 1 user side
BWS Hardware Protocole IP
Port 3: JTAG
Port 1: Events
Port 2: IO
Port 4: SoC Master
Port 5: SoC Slave
Port 6: Stream IN
Port 6: Stream OUT
BWS Hardware Protocole IP
Port 3: JTAG
Port 1: Events
Port 2: IO
Port 4: SoC Master
Port 5: SoC Slave
Port 6: Stream IN
Port 6: Stream OUT
Development scheduled
Virtual Event link
FPGA Transceivers
Line driver
(Bits)
Data Link
Could probably be
based on GBT layer
(tbc)
BI-TB for inter-FPGA communication - J.Emery

5. Protocol layer architecture
BI-BWS LINK
Memory mapping between FPGAs Access to any address transparently
SoC mapping master-slave
flash interface
external NVM interface
single access and Large set of data
Point-to-point link
‘Streaming link’
Bandwidth constrained
Virtual communication (Horizontal)
High Level BWS Protocole
(Packets)
Real communication (Vertical)
Virtual JTAG debug tools & boundary scan?
Digital IO
Triggers
JTAG chain
Events/triggers
signals replication
Timely constrained
Low level BWS Protocole
(Frame)
FPGA Transceivers
Line driver
(Bits)
Data Link
BI-TB for inter-FPGA communication J.Emery

6. Use case: Scanner movement start trigger
BI-BWS LINK
FPGA on the Intelligent drive
VFC on the VME
Scanner Movement sequencer
BST engine
Events/triggers
Triggers
Triggers
Low level BWS Protocole
FPGA Transceivers
Line driver
(Bits)
Data Link
BI-TB for inter-FPGA communication - J.Emery

7. Use case: data collection after a measurement
BI-BWS LINK
FPGA Intelligent drive
VFC on the VME
Memory
Memory interface
DMA engine
Memory interface
Memory
‘Memory Mapped’
SoC mapping (Master)
SoC mapping (Slave)
High Level BWS Protocole
Low level BWS Protocole
FPGA Transceivers
Line driver
(Bits)
Data Link
BI-TB for inter-FPGA communication - J.Emery

8. Use case: JTAG chain over serial link
BI-BWS LINK
FPGA Intelligent drive
VFC on VME
Logic analyser
Memory - register read/write contents
JTAG
USB to JTAG
Virtual JTAG (Altera)
Virtual JTAG (Altera)
Virtual JTAG chain
JTAG interface
JTAG inteface
Low level BWS Protocole
FPGA Transceivers
Line driver
(Bits)
Data Link
BI-TB for inter-FPGA communication - J.Emery

9. Verification methodology
BI-BWS LINK
Management of the complexity - multiple ports in - multiple ports out - priority levels
Transaction Level Modelling (TLM)
VHDL based
UVVM (Universal VHDL Verification Methodology) Open source
Similar approach that UVM (in systemVerilog)
Assertions based verification for the interfaces ports
BI-TB for inter-FPGA communication - J.Emery

10. BI-TB for inter-FPGA communication - J.Emery - 29.06.2016
Implementation
BI-BWS LINK
Master Student will work with me for the implementation and the verification environment (from September 2016)
Possibility to include additional requirements of potential users
Master thesis, code and verification environment will be made accessible to users
BI-TB for inter-FPGA communication - J.Emery

11. BI-TB for inter-FPGA communication - J.Emery - 29.06.2016
Summary
BI-BWS LINK
Services requirement described for the BWS serial link
Transport of data and events trough the same channel
Based on layered architecture of communication systems
Low level layer for timely constraints signals, events, IO replication, JTAG
High level layer for transparent mapping of SoC domains, streaming links
Physical and data link layer could be using GBT defined protocol (tbc)
Other potential users are welcome to contact me to discuss additional requirements to be include in this implementation
BI-TB for inter-FPGA communication - J.Emery

12. BI-TB for inter-FPGA communication - J.Emery - 29.06.2016
Additional slides
BI-TB for inter-FPGA communication - J.Emery

13. FPGA Architectures BI-BWS LINK Intelligent Drive FPGA (ID-FPGA)
VME Acquisition and supervision FPGA (AS-FPGA)
FPGA
FPGA
Slave
Interface DACs
VME BUS
Interface
Slave
PWM
EMAC
EXTERNAL SDRAM Interface
Slave
Motor feedback
ARM CPU
Slave
Interface ADCs
CPU
EXTERNAL SDRAM Interfaces
events
events
DMA
BWS Hardware Protocole IP
Transceivers
Transceivers
BWS Hardware Protocole IP
DMA
Soc bus Master
Soc bus Master
Soc bus Slave
Soc bus Slave
flash interface
Digital IO
Virtual JTAG
Virtual JTAG
Digital IO
flash interface
BI-TB for inter-FPGA communication - J.Emery

14. BI-TB for inter-FPGA communication - J.Emery - 29.06.2016
Manoel Barros Slide