Presentation is loading. Please wait.

Presentation is loading. Please wait.

Laatuominaisuuksien standardin ISO25010 ja testausarviointistandardin ISO33063 esittely Risto Nevalainen, Senior Advisor, FiSMA ry.

Similar presentations


Presentation on theme: "Laatuominaisuuksien standardin ISO25010 ja testausarviointistandardin ISO33063 esittely Risto Nevalainen, Senior Advisor, FiSMA ry."— Presentation transcript:

1 Laatuominaisuuksien standardin ISO25010 ja testausarviointistandardin ISO33063 esittely Risto Nevalainen, Senior Advisor, FiSMA ry

2 FiSMA Sisältö  Hieman FISMAsta  SC7 standardoinnista  WG6 ja SQUARE, ISO/IEC  Standardit ja mallit, lähinnä sarja  Esimerkkejä  Mitä seuraavaksi  WG10 ja Testing SPICE, ISO/IEC  Standardit ja mallit, 330xx sarja  33063, esimerkkejä  Mitä seuraavaksi  Keskustelua  HUOM: esittelykalvot ovat englanniksi, helpompi esittää standardit niin ja on valmista materiaalia. Käännöstöitä ei nyt harkinnassa.

3 FiSMA FiSMA organisation 2012 (changes possible) Annual meeting Board 6 members CP: Tuukka Haarni Managing Director Erkki Savioja Senior Advisor Risto Nevalainen Senior Advisor Pekka Forselius Standards and Models CP: Kimmo Vaikkola, Fujitsu IT service mgmt CP: Jyrki Lahnalahti, Inspecta Scope Manager Forum CP: Hannu Lappalainen FiSMA SPIN CP: Jukka Märijärvi Testing Standards and Models CP: Heikki Uusitalo, Endero

4 SC7 Secrétariat Standards Management Group SWG 5 Systems & Software Documentation WG2 Process Assessment WG10 Vocabulary Maintenance SWG22 IT Service Management WG25 WG26 Software Testing Tools and Environment WG4 Techniques for Specifying IT Systems WG19 Systems Quality Management WG23 Life Cycle Management WG7 Software Product Measurement and Evaluation WG6 JTC 1 SC7 Structure Architecture WG42 CIF Usability WG28 SLC Profiles and Guidelines for VSE WG24 SWG 1 Business Planning Group WG20 Software Engineering Body of Knowledge WG21 Software Asset Management IT Governance WG40 Life Cycle Process Harmonization Advisory Group LCPHAG IT Enabled Services (BPO) WG27

5 FiSMA ISO/IEC JTC1/SC7/WG6 Responsibility and Structure Title:  Software Product and Systems Quality Scope:  Development of Standards and Technical Reports for Software Product and System Quality Requirements, Measurement and Evaluation Organizational Structure:  SQuaRE Series (ISO/IEC ~ 25099) => WG6  Functional Size Measures => WG6/FSM SG  CIF (ISO/IEC ~ 25069) => JWG => WG28

6 FiSMA Organization of SQuaRE series of International Standards

7 FiSMA Quality model division, 2501x  This division states the general requirements for a quality model, recommended model, and guides to customize and use the model.  This division consists of two parts:  ISO/IEC 25010: System and software quality models  A quality in use model composed of five characteristics (11 subc.).  A product quality model composed of eight characteristics (31 subc.).  ISO/IEC 25012: Data quality model  The data quality model defined in this International Standard categorizes quality attributes into fifteen characteristics (22 views) considered by two points of view: inherent and system dependent.  New: ISO/IEC Service Quality  Professor Markku Tukiainen is nominated as co-editor by Finland

8 FiSMA ISO/IEC JTC1/SC7/WG6 Hyderabad Meeting Report 8 SQuaRE Architecture and projects ISO/IEC 2504n: Quality Evaluation Division 25030: Quality Requirements (IS) ISO/IEC 2503n: Quality Requirement Division ISO/IEC 2500n: Product Quality General Division ISO/IEC 2501n: Quality Model Division ISO/IEC 2502n: Quality Measurement Division 25010: System and software quality models (IS) 25000: Guide to SQuaRE (IS) 25020: Measurement Reference Model (IS) 25021: Quality Measure Elements (TR) 25022: Measurement of Quality in Use (WD) 25040: Quality Evaluation Process (IS) 2504n: Evaluation Module (NYA) 25041: Evaluation Guide for Developers, Acquirers and Independent Evaluators (DIS) 25001: Planning and Management (IS) 25023: Measurement of Sys & SWP Quality (WD) 25024: Measurement of Data Quality (WD) 25012: Data Quality Model (IS) 25051: Requirements for quality of COTS software product and instructions for testing (IS) ISO/IEC ~ 25099: SQuaRE Extension Division 25045: Evaluation Module for Recoverability (IS) ISO/IEC ~ 25069: Common Industry Format for Usability JWG JTC1/SC7 and ISO/TC159/SC4 ISO/IEC JTC1/SC7/WG6 Paris Meeting Report Rev.: Requirements for quality of COTS software product and instructions for testing (WD) 25021: Quality Measure Elements (DIS) Rev.: Guide to SQuaRE (WD)

9 FiSMA Overview of using SQuaRE Product Quality Requirements Product Quality Evaluation determines supports Customer User Development Organization provide Acquirer Evaluator Developer perform guidance Product Quality Model and Measurement

10 FiSMA Structure used for the quality models Note: also 330xx will use the same structure in near future

11 FiSMA Quality in the lifecycle

12 FiSMA Quality in use model in 25010

13 FiSMA Product quality model (system, software) in 25010

14 FiSMA Next steps in SQUARE  ballot for renewal, CD is closing  series is now started, will add details in quality models by defining set of metrics per model  25020, 25021, 25022, 25023,  So far 9126 is still valid  Professor Markku Tukiainen is nominated as co-editor by Finland in  series is also under work, mainly in CD phase

15 FiSMA Ohjelmistotuotteen laadun mittarit, 2 kpl FiSMA suositus  Suositeltu metriikka: A.1 Käyttäjän työn tehostuminen  Tyyppi: Johdettu mittari  Oleellinen sisältö: Käyttäjätehtävien aste, jota ohjelmisto tukee verrattuna kaikkiin käyttäjätehtäviin. Suositeltu metodi on tapaustutkimus.  Mitä mittari kertoo: Kuinka hyvin ja kattavasti ohjelmisto on toteutettu täyttämään käyttäjän tarpeita.  Suositeltu metriikka: A.2 Käyttäjän tyytyväisyys  Tyyppi: Suora mittari  Oleellinen sisältö: Käyttäjän kokema tyytyväisyys (user experience). Voidaan jakaa osa-alueisiin. Suositeltu metodi on Net Promoter.  Mitä mittari kertoo: Kuinka käyttäjä kokee ohjelmiston toimivan hänen kannaltaan, esim. käytettävyys ja esteettömyys.

16 FiSMA ISO/IEC JTC1/SC7/WG10 Responsibility and Structure Title:  Process Assessment Scope:  Development of Standards and Technical Reports for Software Product and System Quality Requirements, Measurement and Evaluation Organizational Structure:  SPICE Series, Published (ISO/IEC Parts 1 -10)  SPICE Series, Under development (ISO/IEC 3300xx)  Benchmarking, ISO/IEC (several parts)

17 FiSMA ISO/IEC 330xx Plan

18 FiSMA ISO/IEC exemplar process assessment model for software testing  One of the assessment models.  Other identified models are software, systems and services assessment model.  Started almost two years ago  WD in 2011  CD1 during winter 2012  Lot of comments, also from SYTYKE/Testaus OSY  Finland voted against: too complex, too much overlap  Current draft is CD2  Simplified structure: 8 processes  Guidance on how the planning and scoping of an assessment is done with this process assessment model for software testing (Annex B)  NOTE: Also other test assessment models are developing!

19 FiSMA Overall architecture

20 FiSMA Processes in ISO/IEC 33063

21 FiSMA Assessment indicators

22 FiSMA Example: Test Completion process (Normative part)

23 FiSMA Example: Test Completion Process (practice indicators)

24 FiSMA Example: Test Completion Process (work product indicators)

25 FiSMA Capability indicators, capability levels in  Same structure as in draft CD3 ISO/IEC ”Process measurement framework for assessment of process capability and organizational process maturity”  9 process attributes  6 capability levels, ordinal value  NPLF rating for process attribute rating  Additional indicators as in ISO/IEC :2012 model (software)  No maturity scale  No definition or adaptation of assessment by different classes  Note: Possibility that testing (and V&V) are in future also in some other standards in 330xx family  Note: Possibility that someone proposes other kind of process quality characteristics than process capability

26 FiSMA Next steps in  CD ballot is open, closes  FiSMA meeting is to handle comments  Also comments from Testaus OSY are welcome!  Expected future: DIS ballot winter 2013(if ISO/IEC moves also to DIS), publication late 2013  Note: many other parts in are also now under ballot  DIS ballot closes  Note: NWIP proposal in topic ”Keyword driwen testing” is open, closes Any volunteer from Finland to participate?

27 FiSMA Guidance in using at more detailed level  Each process can be assessed at more detailed level  Example: Test Management process can be rated separately for Unit testing, System testing and for Reliability testing  Need for aggregation: higher level rating is combination of several lower level ratings. What is the aggregation rule?  Also processes from other models can be included in the assessment scope  Example: DEV.5 Software Integration from ISO/IEC 15504:5 (2012)

28 FiSMA Training for FiSMA members in testing standards during 2013  Two courses are planned for 2013, no details yet:  2-day course  2-day Testing SPICE (33063) course  No policy how Testaus OSY members can participate, any ideas?  Note: One SPICE training week is also planned, focuses on highly critical applications (Nuclear SPICE etc)  Note: Safety Manager course will be offered for FiSMA members in February 2013, will include heavy practices for V&V. Automotive and industrial automation are main domains. Participation is free also for Testaus OSY.


Download ppt "Laatuominaisuuksien standardin ISO25010 ja testausarviointistandardin ISO33063 esittely Risto Nevalainen, Senior Advisor, FiSMA ry."

Similar presentations


Ads by Google