Continuous verification for hardware/software multimedia systems Philippe Faes

pag. 2Hardware Regression Verification – Philippe Faes – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen Designing once becomes iterative design requirements design implementation verification requirements design implementation verification

pag. 3Hardware Regression Verification – Philippe Faes – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen Iterative design requires more verification working system +small change in feature X = broken feature Y

pag. 4Hardware Regression Verification – Philippe Faes – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen Regression verification (RV) ensures progress-only projects progression regression (painful)

pag. 5Hardware Regression Verification – Philippe Faes – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen RV provides a “contract” never break regression verification: tomorrow ≥ than today working code is never broken never discover bugs twice

pag. 6Hardware Regression Verification – Philippe Faes – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen RTs reduce fear fearboredom... dixit Fowler

pag. 7Hardware Regression Verification – Philippe Faes – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen Requirements for good RV limited scope fast traceable reproducible

pag. 8Hardware Regression Verification – Philippe Faes – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen Good RTs are reproducible uncontrolled environment systemtest results controlled input X

pag. 9Hardware Regression Verification – Philippe Faes – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen Good RTs are reproducible uncontrolled environment systemtest results controlled input X

pag. 10Hardware Regression Verification – Philippe Faes – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen Regression verification needs to be automated

pag. 11Hardware Regression Verification – Philippe Faes – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen Easy testing requires design for testability unit x unit ytest harness unit under test

pag. 12Hardware Regression Verification – Philippe Faes – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen Functionality and data should be split test data test harness unit under test

pag. 13Hardware Regression Verification – Philippe Faes – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen Functionality and data should be split test data unit under test harness

pag. 14Hardware Regression Verification – Philippe Faes – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen software MMIO library is standard interface between SW and HW hardware

pag. 15Hardware Regression Verification – Philippe Faes – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen software MMIO library provides transparent access simulated hardware real hardware log files

pag. 16Hardware Regression Verification – Philippe Faes – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen Transaction can be logged and replayed w f w f w f p r f read write poll busaddressdata byte enable

pag. 17Hardware Regression Verification – Philippe Faes – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen Example: verification of video decoder EDIDWTMCAS Software

pag. 18Hardware Regression Verification – Philippe Faes – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen EDIDWTMCAS Software Verify hardware components one by one IDWT Software logger

pag. 19Hardware Regression Verification – Philippe Faes – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen Verify hardware components without software IDWT log replayer

pag. 20Hardware Regression Verification – Philippe Faes – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen Regression test server does the hard work for you build the system run tests regularly notify stakeholders log failures

pag. 21Hardware Regression Verification – Philippe Faes – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen Regression verification in iterative hardware design regression defects are painful good RV catches regression defects RV can be automated

pag. 22Hardware Regression Verification – Philippe Faes – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen

pag. 23Hardware Regression Verification – Philippe Faes – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen