Presentation on theme: "FPGA Architecture, timing, Software"— Presentation transcript:
1 FPGA Architecture, timing, Software Mose WahlstromLattice Research & Development TeamDecember 2, 2013
2 Overview Mose Wahlstrom, BSEE OSU 1992 At Lattice for last 21 yearsExcited to enhance partnership between Lattice and OSUWill continue to give to OSU (hardware, software, time)Will continue to hire (interns and permanent positions)Will entertain other guest lecturesHere to focus on FPGA architecture, software, and timingNot here to pitch Lattice or recruit. (will be back)Ask questions!(And yell if I use acronyms or unknown terms)This will go fast and I don’t expect 100% of it to stick.Just a general back groud you can build on.
3 topics Field Programmable Gate Array (FPGA) Architecture (~25 min) Top level block diagramsLogic building blocks and signal routingTiming and Power (~15 min)Clocking and control signalsTypical pathFmax and timing constraintsStatic timing analysis (setup/hold and clock to out)Power consumptionSoftware Flow (~10 min)Design capture in Verilog, IPexpressSynthesis into ‘standard’ cellsCell placement and routing in the FPGABitstream generation and device configuration
4 IO Ring Block diagram FPGAs: An array of PLCs Programmable LOGICProgrammableLogic Cell (PLC)ArrayPLCs align by abutmentIncludes both ROUTING and LOGICROUTING tracks cross boundariesLOGIC is self-contained in the PLCThe IO ring contains the Input/OutputsThe IO ring also contains other logicLOGICLOGICLOGICLOGICNOTE: PLC drawn to approximate scaleROUTING comprises ~70% of areaLOGIC comprises ~30% of area
5 MACHXO2 block diagram (XO2-1200) ‘Value added’ features in and around the coresysIO Buffers Support LVCMOS/LVTTL, LVDS Outputs. I/O Logic Supports 7:1 Output GearingUser Flash MemoryOn-chip Flash Memory Provides Instant-on, High Security & Single Chip SolutionEmbedded Function Block Hardened SPI, I2C, Timer/CountersysCLOCK PLLsFrequency Synthesis & Clock AlignmentsysIO Buffers Support LVCMOS/LVTTL, and DDR Memory InterfacessysMEM Block RAM 9Kbit Dual PortProgrammable Function Units (PFUs) with RAMsysIO Buffers Support LVCMOS/LVTTL, LVDS inputs and PCI. I/O Logic Supports 7:1 Input GearingFlexible RoutingOptimized for Speed, Low-Cost and Routability
6 Brief Overview of the PLC The Programmable Logic Cell (PLC) is the fundamental building block of the FPGA Fabric.The PLC consists of 2 components:PFU – Programmable Function Unit (Very simple logic!)Programmable Routing Block or Big Switch Box (Muxes)
7 PFU – Programmable Function Unit Building the PFU from the inside out…Nearly all FPGAs are based on a Look-Up-Table plus Register. Most are a LUT4. Aka LUT4+REG.A 4-input LUT is just a 16-bit ROM, with 4 ‘address’ bits (ABCD) and a ‘data’ bit (F).By programming the ROM, any 4 input logic functions can be formed.Or it can be a simple ROM.q0q2q1q3LUT Memoryq4q6q5q7q8q10q9q11q12q14q13q15ABCDF(‘q’ values are programmable SRAM memory bits that are determined through the design synthesis process)
8 PFU – Programmable Function Unit The Register (Flip-Flop)The REG is a custom configurable register with a CLK and Data (D) input and a Q output.The typical register also contains other options such as: Clock Enable (CE), Set/Reset, Latch mode, and selectable polarities.The LUT and register can be used independently, or the output of the LUT can feed the D input of the register.All other PFU logic supports logic expansion and special enhancements to the LUT+REG.Early FPGAs were just LUTs and registers!(Nearly any logic can be built from just these two blocks.)
9 PFU – Slice Level View PFUs are organized into Slices. They contain: Two 4-Input LUTsTwo RegistersSlice Inputs:LUT Inputs: A, B, C, DRegister Control Inputs: CLK, CE, LSRSlice Outputs:LUT Outputs: FRegister Outputs: Q(More detail Later)
10 PFU – Programmable Function Unit Over time, the PFU has evolved to include other logic to increase performance and logic density.Wider LUTsIn order to perform wider logic functions with minimal performance hit (no general routing), special muxes are added to allow wider LUT functions.The OFX signal is a muxed output from a pair of LUTs. It is controlled by the Miscellaneous (M) input. This creates a LUT5 from inputs ABCDM. Five inputs, 32 possible logical combinations.Additional OFX muxes support LUT6, LUT7, and LUT8.A LUT7 consumes 8 LUT4s (128 memory bits) .It also requires 3 additional ‘address’ inputs (M inputs).RAM modeRAM mode can be implemented by adding some ‘write’ logic to the LUT. This allows the LUT to implement a small 16 bit RAM. The ‘read’ just functions similar to ROM/LUT mode. Write requires ‘borrowed’ signals and logic.Ripple modeRipple Mode is implemented by adding some additional logic and re-purposing the LUT bits to function as a carry-look-ahead adder. Ripple mode supports configurable options for implementing adders, subtractors, and comparators.
11 PFU – Programmable Function Unit Now we put it all together to construct a typical PFU.Wide LUT, RAM, and Ripple mode don’t really have any practical uses with a single LUT. Only when LUTs are grouped together can we build wide logic functions and multi-bit adders and RAMs. Thus the minimal building blocks need to be more than just a single LUT+REG.The ‘SLICE’Pairs of LUT+REG are grouped together with extra RAM/Ripple logic to form SLICEs.Some slices only support LUT/ROM mode; others support RAM/Ripple modes.Different types of slices are bolted together to form the PFU.Ripple and RAM mode are superset slice options.All slices can be used as a LUT and/or a REG.A Typical PFU contains 4 slices. This would contain/support the following:8 LUT4s or up to a single LUT7, up to a 16x8bit pseudo dual port RAM, an 8 bit register or shift register, a full 8bit adder/subtractor/comparator, or other combinations.
12 PFU – Slice Level View Each Slice consists of: Two 4-Input LUTs Two RegistersArithmetic Logic circuits to perform arithmetic operationsCircuitry to support simple RAM mode with additional input signalsSlice Inputs:LUT Inputs: A, B, C, DMulti-Purpose Inputs: MFast Carry Input: FCIRegister Control Inputs: CLK, CE, LSRSlice Outputs:LUT Outputs: FRegister Outputs: QWide Function Outputs: OFXFast Carry Output: FCO
14 PFU – Slice Level View w/control 1LUT4Arithmetic & Carry LogicM1FS1/GEN1F/SUM1F/SUM0M0LSRFXBFXAOFX1DFF_0/Latch_0F1F0Q1Q0OFX0A0B0C0D0A1B1C1D1CLK to FF_1CEFCOFCIFS0/GEN0LSR0LSR1CLK0CLK1CLK_DELCLK to FF_0FF_1/Latch_1The Slice is controlled by programmable SRAM bits.The bits are used to:Set LUT ‘q’ bitsSet Slice to RAM modeSet Slice to Ripple modeSet Register modesReg or latchSet or ResetSet Slice optionsLSR/CE/CLK polaritiesClock and LSR selectionWide LUT modes
15 Additional pfu detail Wide LUTs revisited RAM mode revisited The OFX muxes and the FX/OFX IO signals are dedicated to wider LUT functions. OFX0 is always a LUT5. OFX1 performs a different function in each slice. Two of the slices use the OFX1 mux to generate LUT6s from a pair of LUT5s. One slice can then use OFX1 to generate a LUT7 from the pair of LUT6s. The final OFX1 can be used to generate a LUT8 from its own LUT7 and that of a neighboring PFU.The neighboring LUT7 output/input is one of the few special directly connected signals that span PFUs.RAM mode revisitedImplementing RAM mode requires more signals than are present in a single slice. At a minimum, a Write Enable (WRE) and a Data Input (DI) are needed. However in order to support Pseudo Dual Port (PDP) mode, an additional Write Address (WAD) bus is needed as well as a Write Clock (WCK) for the write port.In a typical implementation, these signals come from one of the other slices. For example, slice 0 and 1 may be used to implement a 16x4 PDP RAM. Slice 2 is ‘burned’ to generate the control signals, which are sent to slice 0/1. And slice 3 doesn’t support RAM mode.Thus there are special RAM mode signals sent between slices. These signals are dedicated for RAM mode and do not leave the PFU.
16 Additional pfu detail (cont.) Ripple mode revisitedRipple mode repurposes a pair of LUTs to implement a full 2-bit Carry Look-Ahead (CLA) adder. The LUT is programmed as a ROM and slightly modified to produce Propagate and Generate signals from the (4) inputs and the carry input signal.By adding dedicated Fast Carry Input/Output (FCI/FCO) signals, performance is greatly improved when compared to arithmetic functions using LUT logic and general routing resources.Ripple mode is not a full CLA, but rather a chain of 2-bit CLAs with a dedicated, rippling fast carry chain.Every slice has a FCI and FCO port that connect adjoining slices. At the PFU boundary, the FCI and FCO connect between neighboring PFUs (typically L to R).
17 Programmable Routing Block ROUTING: (The other three-quarters of the PLC)The general purpose routing is not deterministic. It is a collection of pseudo-random paths. The design software, user preferences, design congestion, and random seeding all affect the signal routing.The routing portion of the PLC can be divided into the signal wires and the switch boxes that feed them. The wires carry signals from one PLC to another. The switch boxes are the programmable source connections.Once again, the programmable connections are controlled by SRAM bits.There are two distinct categories of switch boxes.Input Switch Boxes (ISBs) are muxes that feed the inputs to the PFU. Output Switch Boxes (OSBs), are muxes that feed the routing wires out of the PLC.The source for each ISB and OSB is a programmable mux. The inputs to the mux determine what subset of signal sources can drive that particular wire or PFU input. A typical routing mux contains about 20 inputs.The muxes are typically two stage, one-hot pass-gate muxes.
18 Programmable Routing Block In general, the routing wire segments are unidirectional, buffered segments that span either 2, 3, or 7 PLC blocks (Seg-1, Seg-2, Seg-6 or X1, X2, X6).The wires feed both horizontally and vertically in all four directions.(X0 wires are an additional special case that are local to a PLC and are really just an additional layer of connections to enhance routability.)M0M1M2M4M3I0I1I2I3I4I5Mux OutputPre-DriverDriverTo Connect I0 to Mux Output:Turn ON progammable SRAM memory cells M0 and M3
19 Programmable Routing Block The BSB contains hundreds of programmable muxes.The ISBs feed into the PFU to drive:LUT and M inputsClock inputsCE and Local Set/Reset inputsThe OSBs feed out of the PLC:OSBs drive all the segment wires (X0, X1, X2, X6)The sources for OSB muxes are a pseudo-random selection of both PFU outputs and other routing wires.The following horribly confusing diagram illustrates a high level view of the routing structure.In general, the routing muxes are sparsely populated. Only a small fraction of the possible wires feeds each ISB or OSB.The software must search many possible options to find a route. This includes swapping LUT inputs, moving logic drivers, and duplicating logic.
21 PLC Routing Connectivity Example: LUT ISB Mux connectivityCE, LSR, CLK are similar but include global clock resourcesDirects are local:F/Q of local PFUF for wider logicQ for Counters, State machinesOthers inputs are from general routing.The mux controls are set static by SRAM programming bitsTo PFU LUT Inputs (A,B,C,D) and M
22 PLC Routing Connectivity Example: X1 ‘Output’ Mux connectivityMux controls arestatic SRAM(Similar for X2, X6 and even the local X0, however not limited to just PFU outputs. X2/X6/X0 primarily source other routing resources)
23 PLC Routing Connectivity The Hierarchical Routing Connectivity ConceptSimilar to a system of roads:Expressways with limited off rampsLocal highwaysNeighborhood streetsX6X2LUTISBA0B0C0D0A1B1C1D1SLICE 0LUT 0LUT 1Bank 0X0Type1Type2Type3
24 Global routing (CLOCK timing) In addition to the general purpose routing, there are some global control signals that feed the entire PLC array and the peripheral logic in the IO ring.The most important global signals are the clock signals. (Synchronous logic)All FPGA devices contain clock ‘trees’ to guarantee all registers receive the clock at essentially the same time to provide deterministic setup and hold times between registers. This is known as the primary clock tree, which has many branches and programmable options for clock gating, switching, and power control.All clock signal trees have special routing mux resources to choose their sources. These muxes are located in the central clock switch.The sources for the clocking resources are a mix of general purpose routing, dedicated IO pins, Phase Lock Loop (PLL) outputs, and other clock resources. This allows the implementation of complex clock systems with both internal and external clocks, multiple clock frequencies, and various clock phases.All devices have a Global Set Reset (GSR). This signal fans out to every register in the device, both in the PLC array and in the IO ring. This provides a system reset.From a user’s perspective, these are the only significant global signals. However there are lots of other global signals dedicated to programming, power control, etc.
25 Clock treeIO RingClock trees guarantee identical clock delay to all registers.This includes PLC registers and IO ring IP blocks such as IO cells and embedded RAM.There are many parallel clock trees to support multiple clock domains.The software controls all timingPFU to PFUPFU to IO ringPFU to IP blockIP block to PFUREGCENTRALCLOCKSWITCHREG……Clock Input Source
26 Typical signal Path Typical Path: A 4-logic-level deep register-to-register pathPath Delay = (CLK2Q + LUT4 delays + FF_Setup) + (OSB Routing + ISB)The routing delays could represent local intra-PLC delays, or they could be inter-PLC delays crossing the entire PLC array.(Not shown is the clock signal, which also has a delay.)Routing delayRouting delayRouting delayRouting delayPFUALUTFFDQRouting+ ISBCLK2QLUT4 delayLUT4_delay+FF SetupLUT4 delay
27 Software timing control All routing structures, PFU logic elements and peripheral IP blocks require specific timings in order to function correctly. There are three basic timing constructs: FMAX, routing delays, and Port Timings.FMAX (Maximum Operating Frequency)IP blocks, PFU modes, and clock trees all have an explicit FMAXA Block RAM may have an FMAX of 300MHZ, beyond which read or write functional will fail to execute correctly.An LVCMOS IO standard may have an FMAX of 250MHZ, beyond which the high and low output level would be violated.These FMAX values are determined by simulation of the design (Lattice Spice sims), by characterization, or by ‘binning’ at final test.The FMAX values are provided to the software to limit a users allowed operating frequency.The sum of the routing delays between registers can also determine a ‘design specific’ maximum operating frequency.Every signal path (route) in a user’s design has a specific delay.There is usually a very small fraction of routes (or even a single route) that may also limit the maximum operating frequency.Users enter their desired operating frequency and the software checks to make sure that all blocks and resources meet the FMAX constraints.
28 Software timing control (cont.) Routing Delays and Port TimingsAll synchronous blocks require specific Setup/Hold time (TSU/TH) on IN ports and they provide specific Clock To Out (TCO) on OUT ports.These TSU/TH/TCO values are determined by simulation of the device, by characterization, or by ‘binning’ at final test.The routing delays of each wire and mux type (X2, X6, ISB, OSB) are also simulated and characterized.All these port and routing timings are integrated into the software so that it can determine timing closure on every signal path between register.For the software to be effective, users must enter timing ‘constraints’.This sets FMAX and prioritizes internal requirements (general goals).External IO requirements must also be provided (TSU/TH/TCO).These are determined by off-chip clock and data alignments, such as from an external memory, interface chip, or processor.With all of the above information, the software attempts to meet all static timing requirements. It has many options such as:Moving logic (registers) closer together to fix a Setup time violation.Intentionally adding delay to a route to fix a Hold time violation.Duplicating logic closer to a destination to fix a setup time violation.Giving up.
29 FPGA Power CONSUMPTION The software can also estimate power consumption.Similar to the timing, the power data comes from many sources such as: Spice simulations, characterization, and final test ‘binning’.Power data is integrated into the software for each routing element, PFU mode, and IP block. There are two basic components of power, DC and AC power.DC power consumption:DC power is comprised of static bias currents and leakage.The leakage currents are calculated from a curve fit equation based on supply voltage (VCC), Temperature, and process variation (typical or worst-case). The software provides users the means to enter VCC and temperature as well as select the process.Every LUT, Block RAM, routing wire, etc. has different bias and leakage.There are also different calculations based on if an element is used or unused in a particular user’s design.The software will also generate statistical averages when logic values affect DC bias or leakage current (a ‘1’ and ‘0’ may be different).
30 FPGA Power CONSUMPTION (cont.) AC power consumption:For routing, only a function of:Capacitance (extracted from layout, technology, and simulation)Voltage (Provided by customer’s design)Frequency (average switching frequency of each ‘wire’)Every ‘wire’ will switch at different rates depending on the design, activity, and time slice.Activity Factor (AF) is provided by the customer as an average indicator of switching rates (0%-100%)For the PFU logic and other IP blocksThe same CVF method can be used. ‘Capacitance’ values are provided in the software for each IP block.Users must enter the clock frequency for each clock that feeds the PFUs and IP blocks.Total Power:Total power is the summation of ‘used’ DC, ‘unused’ DC, and AC CVF.Every routing, PFU, and IP element is separately calculated and summed together to produce the total power for the entire FPGA.Every supply is analyzed separately.
31 Software Flow ‘ispLEVER’ is the old name for the Diamond software. Users capture their design, usually with Verilog and other GUI and file inputs.Synthesis turns Verilog into ‘standard cells’ that are the fundamental building blocks of logic:Logic equations, registers, adders, memory, etc.This step is pretty much voodoo to me.Lattice provides architectural info to Synopsys.
32 Software Flow (Cont.)The logical building blocks are then ‘mapped’ to FPGA specific resources such as:LUTs, Block RAMs, ripple adders, PLLs, etc.All of the logic elements are then ‘placed’ into appropriate sites in the FPGA.LUT equations are placed in Slices.RAMs in Block RAM locations.If the device runs out of resources, it will try to remap some of the elements, or it will ultimately fail.LUTs are placed in specific Slices, etc.Once placed, all signals are then routed.The software can rearrange placement if it encounters routing limitations.Some designs will fail to route.The final step is ‘bitstream’ generation.This process sets all of the programmable SRAM bits to implement the logic and routing in the designThe bitstream is then loaded into the device SRAM bits to implement the user’s function. (Or into Flash Memory)
33 OTHER I believe all of these tools are available in the free software. EPIC (don’t know this acronym)EPIC is a GUI tool included in the software that can be used to view, analyze and design nearly every aspect of the FPGA.It shows every routing segment, LUT, IP block, etc.It is very cumbersome and difficult to learn.NCLThe software can also generate an NCL (NeoCad Listing?), which is a text version of the design files that the Map, Place, and Route tools operate on.Once again, very cryptic and difficult to learn. But it is a text representation of an entire user’s design with all routing and logic.Power CalculatorCan be used to estimate FPGA power consumption.