27/11/02DEFINE Workshop, Pisa1 Robustness Testing Marie-Claude Gaudel, LRI Thierry Jéron, IRISA Collaborations with IMAG, LABRI, LAAS (CNRS/AS « méthodes avancées de test »)

27/11/02DEFINE Workshop, Pisa2 What is Robustness Testing? u Robustness*: the ability of a system to keep an acceptable behaviour in presence of « hazards » u Hazards: faults, invalid inputs, or stressful variations in the usage profile u Specificities: – Hazards as test inputs – Acceptability as an oracle *Definitions elaborated by the (CNRS/AS group)

27/11/02DEFINE Workshop, Pisa3 Robustness Testing and Dependability u Going beyond the limits of the nominal input domain and of the nominal behaviours … How far? u Validating fault-tolerance mechanisms by suitable combination of workload and faultload approaches – Inspiration from and to conformance testing methods – Integration of software fault injection techniques u Extending the (formal) models accordingly u (Robustness) testing and dependability assessment??