ECE 477 Design Review Team 2  Fall 2007

Outline Project overviewProject overview Project-specific success criteriaProject-specific success criteria Block diagramBlock diagram Component selection rationaleComponent selection rationale Packaging designPackaging design Schematic and theory of operationSchematic and theory of operation PCB layoutPCB layout Software design/development statusSoftware design/development status Project completion timelineProject completion timeline Questions / discussionQuestions / discussion

Project Overview The Hooked on Harmonix system is a learning tool intended to teach the user how to play the keyboard. The system consists of a midi keyboard, a processing unit, and a display with speakers. The user will choose a song that he would like to learn. The song will then be played through the system speakers while the corresponding notes are streamed on the display. The user will then attempt to match the correct notes and timing using the keyboard to play the song. Hooked on Harmonix will provide dynamic feedback while the song is played to help the user improve his play.The Hooked on Harmonix system is a learning tool intended to teach the user how to play the keyboard. The system consists of a midi keyboard, a processing unit, and a display with speakers. The user will choose a song that he would like to learn. The song will then be played through the system speakers while the corresponding notes are streamed on the display. The user will then attempt to match the correct notes and timing using the keyboard to play the song. Hooked on Harmonix will provide dynamic feedback while the song is played to help the user improve his play.

Project-Specific Success Criteria An ability to (audibly) play and (internally) decode note/timing information from a pre-existing song/data file.An ability to (audibly) play and (internally) decode note/timing information from a pre-existing song/data file. An ability to decode/encode data output by a standard MIDI keyboard into a format compatible with the aforementioned song/data file.An ability to decode/encode data output by a standard MIDI keyboard into a format compatible with the aforementioned song/data file. An ability to display the notes the user should play based on data provided by the decoded song file (as mentioned above).An ability to display the notes the user should play based on data provided by the decoded song file (as mentioned above). An ability to compare user input from the MIDI keyboard with data generated by the decoded sound file on the basis of note/timing accuracy.An ability to compare user input from the MIDI keyboard with data generated by the decoded sound file on the basis of note/timing accuracy. An ability to calculate (and display) a performance score for the user based on the accumulated note/timing accuracy.An ability to calculate (and display) a performance score for the user based on the accumulated note/timing accuracy.

Block Diagram Flash (Config)

Component Selection Rationale MicrocontrollerMicrocontroller –FPGA For video output –SRAM, Flash, Clock can be external –DE2 Board available MemoryMemory –Video Buffering –Graphic and Audio Storage –FPGA Configuration

Packaging Design 6 x 6 x 2 inch box6 x 6 x 2 inch box Separate PeripheralsSeparate Peripherals –Monitor –MIDI Keyboard

Schematic/Theory of Operation I/O Sheet Power Sheet

Schematic/Theory of Operation Voltage Regulation (LD1117)

Schematic/Theory of Operation FPGA receives clock signal from an 80 MHz oscillator FPGA internally divides input clock into 40 MHz and MHz signals Clock Frequencies (ASFL1)

Schematic/Theory of Operation Serial Configuration Device (EPCS64)

Schematic/Theory of Operation SRAM (IS61LV5128AL)

Schematic/Theory of Operation Cyclone II FPGA (EP2C20)

Schematic/Theory of Operation DAC – 8 Bit (ADV7123JST330) Converts digital RGB to analog VGA video

Schematic/Theory of Operation MIDI input through opto-isolator (6N137)

Schematic/Theory of Operation MIDI synthesizer LSI (BU8793KN)

PCB Layout – Overall Considerations Chip ArrangementChip Arrangement –SRAM: address and data busses –DAC: RGB digital video data –MIDI synthesizer chip EMI managementEMI management –Analog signals (DAC, MIDI out) –Clock signals Power and Ground pin outPower and Ground pin out –Bypass capacitors –Power and ground planes

PCB Layout – FPGA

PCB Layout – Voltage Regulators

PCB Layout - SRAM

PCB Layout - Flash

PCB Layout - Oscillator

PCB Layout – MIDI Synthesizer

PCB Layout - DAC

PCB Layout – Optical Isolator

PCB Layout – Headers/Jacks

Software Design/Development Status Load program from flash Load sprites from flash to SRAM Display song menu Song chosen? No Yes

Software Design/Development Status Load song from flash Pass note info sequentially to FPGA Watch MIDI input Correct note in time tolerance? No Yes

Software Design/Development Status NoYes Increment score (show message) Decrement score (show message) End of song? Show final score No Yes

Software Design/Development Status Counter process used for song timingCounter process used for song timing Pass pixel values from SRAM to DAC at appropriate pixel clock intervalsPass pixel values from SRAM to DAC at appropriate pixel clock intervals –40 MHz pixel clock for 800 x 600 resolution at 60 Hz refresh rate Send HSYNC and VSYNC signals during horizontal and vertical blanking periods, respectivelySend HSYNC and VSYNC signals during horizontal and vertical blanking periods, respectively

Project Completion Timeline Obtain All Parts Finalize PCB Populate PCB Sprites on screen Parse MIDI Bars Scrolling Bar Linked to MIDIPlay Comparison Software Complete OctoberNovember Week 3Week 4Week 1Week 2Week 3Week 4Week 5 VHDL Tutorials NIOS II Tutorials Output MIDI Menu Screens Scoring and Timing VHDL Complete Static Images Shown Key:C++VHDLPCB Debug PCB Hardware Complete

Questions / Discussion