1 ® ® Agenda 8:30 a.m.Introduction to The MathWorks, Xilinx, and Avnet 9:00 a.m.Video System Design with Simulink 9:45 a.m.Break 10:00 a.m.FPGA Implementation with Xilinx Tools 11:00 a.m.Co-simulation and Hardware Integration 11:30 a.m.Summary and Wrap-up

2 ® ® Video System Design Challenges  Analyze data, explore ideas, develop algorithms  Manage timing and concurrency issues  Understand the system-wide context  Incorporate hardware constraints  Test and verify design without final hardware  Iterate back to modify algorithm

3 ® ® Using Simulink for Video System Design Analyze design trade-offs Multidomain modeling Automatically generate hardware and software Rapidly prototype ideas Implicit timing and concurrency Incorporate legacy code MATLAB, C, C++, Ada, Fortran, RTL

4 ® ® Simulink Key Features  Block diagram environment  Hierarchical, component-based modeling  Nonlinear, mixed-signal, multirate and multitasking system simulation  Extensive library of predefined blocks  Application-specific libraries available  MATLAB integration Model, simulate, and analyze multidomain systems

5 ® ® Go Farther with Simulink and Blocksets  Signal Processing Blockset  Video and Image Processing Blockset  Communications Blockset  RF Blockset

6 ® ® Demo: Introduction to Simulink Use Simulink Blocks to build your algorithm and model your system View signals from block to block to determine the effectiveness of your model Construct your model through an intuitive block diagram

7 ® ® Demo: Background Estimation Extract a video frame to use as a background Segment the two individuals from the rest of the scene

8 ® ® Demo: Optical Flow Compare algorithms to segment cars from the road Draw bounding boxes and count the number of cars in the frame

9 ® ® Video Processing Required Products  MATLAB  Simulink  Signal Processing Toolbox  Image Processing Toolbox  Signal Processing Blockset  Video and Image Processing Blockset

10 ® ® Why use Simulink for Video Processing?  Modeling and simulation  Easily process streaming video  Visualize results at each step in your model  Extensive block library  Hundreds of blocks supporting video and image processing  No need to recreate standard algorithms  Multidomain modeling  Model ideas outside your area of expertise  Explore system-level design parameters  Integrate existing design components

11 ® ® Case Study: Abandoned Object Detection

12 ® ® Video System Design Challenges Analyze data, explore ideas, develop algorithms Manage timing and concurrency issues Understand the system-wide context  Incorporate hardware constraints  Test and verify design without final hardware  Iterate back to modify algorithm Where do we stand so far?

13 ® ® Incorporating Hardware Constraints  Convert from floating- to fixed-point data types  Model the dataflow for your hardware:  Line buffers for DSPs  Serial bitstream for FPGAs  Use blocks that can create the code you want:  Video and Image Processing Blockset -> C code  Xilinx System Generator -> HDL code

14 ® ® Why use Simulink for Test and Verification?  Rapid test harness construction  Reuse existing code as your “golden reference” model  Easily set up test vectors, in-the-loop visualizations, and post-test analyses  Unified verification environment  Model mixed-signal, multirate, and other complex systems  Interface with third-party environments and tools  Continuous verification  Write less analysis code, spend more time on ideas  Incorporate hardware-in-the-loop testing

15 ® ® Agenda 8:30 a.m.Introduction to The MathWorks, Xilinx, and Avnet 9:00 a.m.Video System Design with Simulink 9:45 a.m.Break 10:00 a.m.FPGA Implementation with Xilinx Tools 11:00 a.m.Co-simulation and Hardware Integration 11:30 a.m.Summary and Wrap-up